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The Lax-Oleinik semi-group: a Hamiltonian point of view. 

Patrick Bernard 
CANPDE crash-course, Edimbourg, February 2011. * 

I The Weak KAM theory was developed by Fathi in order to study the dynamics of convex Hamiltonian 

f^ systems. It somehow makes a bridge between viscosity solutions of the Hamilton-Jacobi equation and 

C\J Mather invariant sets of Hamiltonian systems, although this was fully understood only a posteriori. These 

V^ theories converge under the hypothesis of convexity, and the richness of applications mostly comes from 

this remarkable convergence. In the present course, we provide an elementary exposition of some of the 

basic concepts of weak KAM theory. In a companion lecture, Albert Fathi exposes the aspects of his 

theory which are more directly related to viscosity solutions. Here on the contrary, we focus on dynamical 

applications, even if we also discuss some viscosity aspects to underline the connections with Fathi's 

lecture. The fundamental reference on Weak KAM theory is the still unpublished book of Albert Fathi 

Weak KAM theorem in Lagrangian dynamics. Although we do not offer new results, our exposition is 

original in several aspects. We only work with the Hamiltonian and do not rely on the Lagrangian, even if 

some proofs are directly inspired from the classical Lagrangian proofs. This approach is made easier by the 

(^ choice of a somewhat specific setting. We work on W^ and make uniform hypotheses on the Hamiltonian. 

"ti This allows us to replace some compactness arguments by explicit estimates. For the most interesting 

ri dynamical applications however, the compactness of the configuration space remains a useful hypothesis 

I I and we retrieve it by considering periodic (in space) Hamiltonians. Our exposition is centered on the 

Cauchy problem for the Hamilton-Jacobi equation and the Lax-Oleinik evolution operators associated to 

it. Dynamical applications are reached by considering fixed points of these evolution operators, the Weak 

KAM solutions. The evolution operators can also be used for their regularizing properties, this opens a 

\j^ second way to dynamical applications. 
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1 The method of characteristics, existence and uniqueness of 
regular solutions. 

We consider a C^ Hamiltonian 

H{t,q,p) :MxM'^ xM'^* — >R 
and study the associated Hamiltonian system 

q{t)=dpH{t,qit),p{t)) , pit) = -dgH{t,q{t),p{t)) (HS) 

and Hamilton-Jacobi equation 

dtU + H{t,q,dgu{t,q))=0. (HJ) 

We denote by Xh{x) = Xjj{q,p) the Hamiltonian vector field Xjj = JdH, where J is the matrix 



J 



/ 
-/ 



The Hamiltonian system can be written in condensed terms x{t) = X}j{t^x{t)). We will always 
assume that that the solutions extend to M. We denote by 

ifl = {Q\, P^) : R'^ X R'^* — >R'^ X R'^* 

the flow map which, to a point x G T*R'^, associate the value at time t of the solution x{s) of 
(HS) which satisfies x(r) = x. 

If u{t, q) solves (HJ), and if q{s) is a curve in M"*, then the formula 

u{ti,q{ti))-u{tQ,q{tQ)) = I dqu{s,q{s)) ■ q{s) - H{s,dqu{s,q{s)))ds (1) 

follows from an obvious computation. The integral on the right hand side is the Hamiltonian 
action of the curve s i — > {q{s), dqu{s, q{s))). The Hamiltonian action of the curve {q{s),p{s)) 
on the interval [toj^i] is the quantity 

p{s) ■ q{s) - H{s, q{s),p{s))ds. 
to 

A classical and important property of the Hamiltonian actions is that orbits are critical points 
of this functional. More precisely, we have: 

Proposition 1. The C^ curve x{t) = {q{t),p{t)) : [to,ti] — > R'^ x M*^* solves (HS) if and only 
if the equality 

^ (J ' p{t, s) ■ q{t, s) - H{t, q{t, s),p{t, s))dt 

where the dot is the derivative with respect to t, holds for each C^ variation x{t, s) = {q{t, s),p{t, s)) 
[to,ti] X R — > M^ X M"'* fixing the endpoints, which means that x{t, 0) = x{t) for each t and that 
q{to, s) = q{to) and g(ti, s) = q{ti) for each s. 



Proof. We set e{t) = dsq{t,0), ({t) = dsp{t,0) and compute: 



d_ 
ds 



h 
pit, s)q{t, s) - H{t, q{t, s),p{t, s))dt 
\Jto 

' p{t)m + mm - dgH{t, q{t),p{t))e{t) - dpHit, qit),pit))C{t)dt 
to 

p{h)9{ti) - p{to)9{to) + f ' im - dpH{t, q{t),p{t)))C{t)dt 

Jto 

\p{t) + dgH{t,q{t),p{t)))9{t)dt. 
to 

As a consequence, the derivative of the action vanishes if {q{t),p(t)) is a Haniiltonian trajectory 
and if the variation q{t, s) is fixing the boundaries. Conversely, this computation can be apphed 
to the variation q{t, s) = q{t) + s9{t),p{t, s) = p{t) + sC,{t), and impHes that 

' [q{t)-dpH{t,q{t),p{t)))at)dt- f \p{t) + d,H{t,q{t),p{t)))9{t)dt = 

to Jto 

for each C^ curve 9{t) vanishing on the boundary and each C^ curve C(0- This imphes that 
q{t) - dpH{t,q{t),p{t)) = 8.nd p{t)+dqH{t,q{t),p{t)) = 0. □ 

We now return to the connections between (HS) and (HJ). A function is said of class C^'^ if 
it is differentiable and if its differential is Lipschitz. It is said of class C^^^ if it is differentiable 
with a locally Lipschitz differential. The Theorem of Rademacher states that a locally Lipschitz 
function is differentiable almost everywhere. 

Theorem 1. Let il C M x R be an open set, and let u{t,q) : Q — > M. be a C^j^ solution of 
(HJ). Let q{t) : [^0,^1] — > ^"^ be a C^ curve such that {t,q{t)) € Q and 

q{t) = dpH{t,q{t),d,u{t,q{t))) 

for each t G [to,ii]- Then, setting p{t) = dqu(t,q{t)), the curve (g(t),p(t)) is C^ and it solves 
(HS). 

The curves q{t) satisfying the hypothesis of the theorem, as well as the associated trajectories 
{q{t),p[t)) are called the characteristics of u. 

Proof. Let 9{t) : [toi^i] — ^ '^'^ be a smooth curve vanishing on the boundaries. We 
define q{t,s) := q{t) + s9{t) and p{t,s) := dqu{t,q{t,s))). Our hypothesis is that q{t) = 
dpH{t,q{t),p{t)), which is the first part of (HS). For each s, we have 

mi^m)) - mO:Qito)) = / Pit,s)-qit,s)-H{t,q{t,s),p{t,s))ds 

Jto 

hence ^| ^„(J^^p{t,s)q{t,s) — H{t,q{t,s),p{t,s))dt] =0. We now claim that 

/ ' dgH{t, q{t),p{t)) ■ 9{t) - p{t)9{t) dt= ^ ( r p{t, s)q{t, s) - H{t, q{t, s),p{t, s))dt) . 

Jto "■^ s=o \Jto J 

Assuming the claim, we obtain the equality /^ ^ dqH{t, q{t),p{t)) ■ 9{t) —p{t) ■ 9{t) dt = for each 
smooth function 9 vanishing at the boundary. In other words, we have 

p{t) = -dqH{t,q{t),p{t)) 



in the sense of distributions. Since the right hand side is continuous, this imphes that p is C^ 
and that the equahty holds for each t. We have proved the theorem, assuming the claim. 

The claim can be proved by an easy computation in the case where u is C^. Under the 
assumption that u is only C^^^ , the map p is only locally Lipschitz, and some care is necessary. 
For each fixed 9, we have 

dqH{t, q{t, s),p{t, s)) ■ e{t) - p{t, s) ■ m = dgH{t, q{t),p{t)) ■ 0{t) - p{t) ■ e{t) + 0{s) 
dtq{t, s) - dpH(t, q{t, s),p{t, s)) = q - dpH{t, q{t),p{t)) + 0{s) = 0{s) 

where 0{s) is uniform in t. We then have, for small S > 0, 

'' dgH{t,q{t),p{t))-e{t)-p{t)-e{t)dt 

'to 

--0{S) + \ r I d,H{t, q{t, s),p{t, s)) • e{t) - p{t, s) ■ e{t) dsdt 
^ Jto Jo 
rU rS 



=0(5) + ^ /" V dgH-dsq-p- dstq + {dtq - dpH) ■ d^p dsdt 
^ Jto Jo 

--0{S) + ^ r [p-dtq-H]ldt = 0{S) + \\r p-dtq-Hdt 

^ Jto ^ Jtn 



'to Jo 

rti 

'to 
We obtain the claimed equality at the limit S — > 0. q 

The following restatement of Theorem 1 has a more geometric flavor: 

Corollary 2. Let 17 C M x M be an open set, and let u{t,q) : Q, — > M. be a C^J^ solution of 
the Hamilton Jacobi equation (HJ). Then the extended Hamiltonian vector-field Yh = [I^Xh) 
is tangent to the graph 

G:={{t,q,dqu):{t,q)en}. 

Proof. Let us fix a point (tg, qo) in (7. By the Cauchy-Lipschitz theorem, there exists a solution 
q{t) of the ordinary differential equation q = dpH (t, q{t) , dqu{t, q{t))) , defined on an open time 
interval containing to and such that q{tQ) = qQ. Let us define as above p{t) := dqu{t,q{t)). The 
curve {t,q{t),p{t)) is contained in the graph G, and we deduce from Theorem 1 that it solves 
(HS). As a consequence, the derivative Yh of the curve (t, q{t),p{t)) is tangent to G. q 

Corollary 3. Let u{t,q) be a C^j^ solution of (HJ) defined on the open set Q =]to,ti[x'K'^. 
Then, for each s and t in ]to,ti[ we have 

Tt = ^iiTs), 

where Fj is defined by 

Tt:={{q,dut{q)):qeR''}. 

Proof. Let {qs,Ps) be a point in F^. Let us consider the Lipschitz map 

F{t, q) := dpH{t, q, dqu{t, q)), 

and consider the differential equation q{t) = F(t,q{t)). By the Cauchy-Peano Theorem, there 
exists a solution q{t) of this equation, defined on the interval ]t~, t"'"[9 s, and such that q{s) = qg. 
Setting p{t) = dgu{t,q{t)), Theorem 1 implies that the curve {q{t),p{t)) solves (HS). We can 
chose t~^ such that either t"*" = t^ or the curve q{t) is unbounded on [s,t^[. The second case 



is not possible because {q{t),p{t)) is a solution of (HS), which is complete, hence we can take 
t~^ = ti. Similarly, we can take t~ = to- We have proved that {q{t),p{t)) is the Hamiltonian 
orbit of the point {qs,Ps)- Then, for each t £]tQ,ti[, we have 

ipi{qs,Ps) = {q{t),p{t)) = {q{t),dqu{t,q{t))) G r*. 

Since this holds for each {qs,Ps) G T^, we conclude that ^pl{Ts) C Tt for each s,t £]tQ,ti[. By 
symmetry, this inclusion is an equality. q 

Let us now consider an initial condition uo{q) and study the Cauchy problem consisting of 
finding a solution u{t,q) of (HJ) such that u{0,q) = UQ{q). 

Proposition 4. Given a time interval ]tQ,ti[ containing the initial time t = and a C^^^ 
initial condition uq, there is at most one C^^^ solution u{t,q) ■.]to,ti[xM.'^ of (HJ) such that 
u{0,q) = Uo{q) for allqGR'^. 

Proof. Let u and u be two solutions of this Cauchy problem. Let us associate to them the 
graphs Tf and Tt, t £]to,ti[. Since u{T,q) = u{T,q), we have F,- = L,- hence, by Corollary 3, 

Tt = ^i{Tr)=ipi{fr)=rt. 

We conclude that dqU = dqU, and then, from (HJ), that dtu = dfU. The functions u and u thus 
have the same differential on ]to,ii[xIR'^, hence they differ by a constant. Finally, since these 
functions have the same value on {r} x M , they are equal. q 

To study the existence problem, we lift the function uq to the surface Fq by defining wq = 
uq o tt, where vr is the projection {q,p) i — > q (later we will also use the symbol vr to denote the 
projection (i, q,p) i — > (t, q)). It is then useful to work in a more general setting: 

A geometric initial condition is the data of a subset Fq C M"^ x M'^* and of a function 
Wo : Fq — > M such that dwo = pdq on Fq. More precisely, we require that the equality 
ds{wQ{q{s),p{s))) = p{s)dsq{s) holds almost everywhere for each Lipschitz curve {q{s).,p{s)) on 
Fq. We will consider mainly two types of geometric initial conditions: 

• The geometric initial condition (Fq, wq = uqo vr) associated to the C^ initial condition uq. 

• The geometric initial condition (Fq = {go} x K'^*,?i;o = 0), for go G '^'^■ 
Given the geometric initial condition (Fo,it'o), we define: 

G:= U WxV'o(ro) (G) 

te]to,ti[ 

and, denoting by Ql{x) the derivative with respect to s, the function 

w: G — >M. 

(^t,x) ^ woiQ^ti^)) + I P!{x)Ql{x) - H{s,^l{x))ds. (w) 

JO 

The pair (G, w) is called the geometric solution emanating from the geometric initial condition 

(Tc-wo)- 

This definition is motivated by the following observation: Assume that a C^ solution u{t, q) 
of (HJ) emanating from the genuine initial condition uq exists. Let (Fo,wo) be the geometric 
initial condition associated to no. Let G be the graph of dqU, as defined in Corollary 3, and let 
w be the function defined on G by u) := no tt. Then, (G, w) is the geometric solution emanating 
from the geometric initial condition Fq . This follows immediately from Corollary 3 and equation 
(1). In general, we have: 



Proposition 5. Let (Tq,wo) be a geometric initial condition, and let {G,w) be the geometric 
solution emanating from {Tq,wo). Then, the function w satisfies dw = pdq — Hdt on G. More 
precisely, for each Lipschitz curve Y{s) = {T{s),9{s)X{s)) contained in G, then for a. e. s, 

l(MTi.)ju).as)))-as)l-H(Y(s))f^. 

Proof. Let us first consider a C^ curve Y{s) = {T{s),6{s),C{s)) on G. We set q{t,s) = 
Q^(s)(^('5)'C(s)) and p{t,s) = P^^^^{e{s),C{s)), and finally x{t,s) = {q{t,s),p{t,s)). We have 

wiT{s),e{s),Cis)) = WoiqiO, s),p{0, s)) + / p{t, s)q{t, s) - H{t, x{t, s))dt. 

Jo 

Since dwo = pdq on Tq, the calculations in the proof of Proposition 1 imply that 

— {woY)= p{0, s) ■ dsq{0, s) + p{T{s), s) ■ dsq{T{s), s) - p{0, s) ■ 9,^(0, s) 
+ {pins),s) ■ dtqins),s) - H{Tis),xiT{s), s))) ^ 
= Cis) (^d^qiTis), s) + dtqiT{s), s)^) + H{Y{s))'^^^. 

The desired equality follows from the observation that dO/ds = dtq(T{s), s){dT/ds)+dsq{T{s), s), 
which can be seen by differentiating the equality 9(s) = q{T{s), s). 

These computations, however, can't be applied directly in the case where Y{s) is only C^, 
or, even worse, Lipschitz. In this case, we will prove the desired equality in integral form 



[w o y]| = f ' C{s) ■ ds9is) - H o Y{s) ■ dsT{s)ds 

J Sn 



for each 5*0 < ^i. Fixing Sq and 5i, we can approximate uniformly the curve Y{s) by a sequence 
Yn{s) : [So, Si] — ^ M X M'^ X M*^* of equi-Lipschitz smooth curves such that y„(5o) = Y{So) 
and Yn{Si) = Y{Si). To the curves Yn, we associate Xn{t,s) = {pn{t,s),qn{t,s)) as above. The 
functions x„ are equi-Lipschitz and converge uniformly to x. In general, we don't have l^(s) G G 
on ]5o,5'i[, hence we don't have j;„(0,s) G Fq, and we cannot express 9sw(x„(0,s)) as we did 
above. Since this is the only part of the above computation which used the inclusion Y{s) G G, 
we can still get: 

— {W o Yn) = —{wo{Xn{Q, s)) - p„(0, s) ■ dsqn{0, s) + Cn{s)dsen{s) + H(Yn{s))dsTn{s). 

ds as 

Noticing that [w o Y]f^ = [w o y„]|i and that [wo{x{0, .))]|^ = [wo{xn{0, .))]sl, we obtain 

[W o y]| = [woix{0, .))]| + / -p„(0, S) ■ dsqniO, S) + Cn{s)dsen{s) + H{Yn{s))dsTn{s)ds 

J So 
'■Si 

p{0, s) ■ dsq{0, s) - _p„(0, s) ■ dsqn{0, s)ds 
'So 

'So 



[ ' Us)dsen{s) + H{Yn{s))dsTn{s)ds. 
J So 



We derive the desired formula at the limit n — > oo, along a subsequence such that 
5sg„(0, .) ^ dsq{0, .), ds9n ^ ds9, dsTn ^ dsT 



weakly-* in L°°, taken into account that 

Pn{0, .) -^ p{0, .), Cn{s) -^ C{S), H{Yn{s)) 



H{Y{s)) 



uniformly, hence strongly in L^ . Recall that a sequence of curves /„ : [toi^i] — ^ I^ is said to 
converge to / weakly-* in L°° if J^ ^ fngdt — > f^ ^ fgdt for each L^ curve g : [to, ^i] — > K'^- We 
have used two classical properties of the weak-* convergence: 

• A uniformly bounded sequence of functions has a subsequence which has a weak-* limit. 

• The convergence j^ ^ fngndt — > J fgdt holds if /„ ^ / weakly-* in L°° and if (7„ — )■ (7 



strongly in L^. 



D 



Corollary 6. // there exists a locally Lipschitz map x ■ ^ — ^ I^^* on some open subset Q, of 
]to,ti[xW^ such that it,q,x{t,(l)) C G for all {t,q) G il, then the function 

u{t,q) ■.= w{t,q,x{t,q)) 

is C^ and it solves (HJ) on Vt. Moreover, we have dqU = x- 

Proof. For each C^ curve (r(s),(5(s)) in 0, the curve 

y(s) = (r(5),Q(s),x(r(s),Q(s)) 

is Lipschitz, hence, by Proposition 5, we have 

d,u{T{s),Q{s)) = dsw{T{s),Q{s),x{T{s),Qis))) 

= x{ns),Q{s)) • dsQ{s) - H{T{s),Q{s),x{T{s), Q(s))a,r(s) 

almost everywhere. Since the right hand side in this expression is continuous, we conclude that 
the Lipschitz functions u{T{s),Q{s)) is actually differentiable at each point, the equality above 
being satisfied everywhere. Since this holds for each C^ curve {T{s),Q{s)), the function u has 
to be differentiable, with dqu{t, q) = xit, q) and dtu{t, q) + H{t, q, x{t, q)) = 0. q 

We have reduced the existence problem to the study of the geometric solution G. We need 
an additional hypothesis to obtain a local existence result. We will rest on the following one, 
which it is stronger than would really be necessary, but will allow us to rest on simple estimates 
in this course. 

Hypothesis 1. There exists a constant M such that 

\\d^H{t,q,p)\\^M 
for each (t, q,p). 

This hypothesis implies that the Hamiltonian vector- field is Lipschitz, hence that the Hamil- 
tonian flow is complete. The hypothesis can be exploited further to estimate the differential 



difl 



dgQiix) dpQlix) 
dgP^ix) dpP^ix) 



using the variational equation 



dgQlix) dpQlix) 
dgP^ix) dpP^ix) 



dqpH{t, x) dppH{t, x) 
-dgpH{t, x) -dppH{t, x) 



dqQlix) dpQlix) 

dqP^ix) dpP^ix) 



We obtain the following estimates: 

\\d^t^ _ /|| ^ e*^l*-^l - 1 

which implies, for |t — t| ^ 1/Af , that 

\\d^\-I\\i^2M\t-T\ (M) 

or componentwise (taking r = 0, and assuming that \t\ ^ M): 

\\dqQ\^-I\\i^2M\t\ , \\dpPl^ - 1\\ i^ 2M\t\ , \\dqPl^\\ s^ 2M\t\ , \\dpQl\\ ^2M\t\. 

We can now prove: 

Theorem 2. Let // : M x M"' x (M^)* 6e a C^ Hamiltonian satisfying Hypothesis 1. Let uq he a 
C"^'^ initial condition. There exists a time T > and a C^J^ solution u{t,q) :] — T, r[xM'^ — > M 
of (HJ) such that u{0,q) = uo{q)- Moreover, we can take 

UM{l + Lip{duo))^ 



and we have 

Lip{dut) ^ Lip{duo) + 4|t|M(l + Lip[duo)Y 

when \t\ ^ T. If the initial condition uq is C^, then so is the solution u{t,q). 

Proof. Let (ro,wo) be the geometric initial condition associated to uq, and let {G,w) be 
the geometric solution emanating from {Tq,wo). We first prove that the restriction of G to 
] — T, T[x]R is a graph. It is enough to prove that the map 

F{t,q):={t,Qi{q,duo{q))) 

is a bi-Lipschitz homeomorphism of ] — T, T[xR'^. By (M), we have 

Lip{F - Id) ^ 2|t|M(l + Lip{duo)) < 1, 

provided \t\ < I 2Af (l + Lip(duQ)) 1 . We conclude using the classical Proposition 50 of the 

Appendix that -F is a bi-Lipschitz homeomorphism of ] — T, TfxR*^. Moreover, if uq is C"^, then 
F is a C^ diffeomorphism. Since F is a homeomorphism preserving t, we can denote by by 
(t, Z{t, q)) its inverse. By Proposition 50, we have 

Lip{Z) ^ 



l-2\t\M{l + Lip{duo))' 

and, under the assumption that |t| ^ T (as defined in the statement), we obtain 

Lip{Z) ^ 1 + 4M|i|(l + Lip{duo)) ^ 2. 

We have just used here that (1 - a)^^ ^ 1 + 2a for a G [0, 1/2]. We set 

Xit,q) = P^{Z{t,q),duo{Z{t,q))), 

in such a way that G is the graph of x on ] — T,T[x]R. . Observing that x is Lipschitz, we 
conclude from Corollary 6 that the function u{t,q) := w{t,q,xit,q)) solves (HJ). Moreover, we 
have u{0,q) = uo{q). Corollary 6 also implies that dut = Xt hence, in view of (M), we have 

Lip{dut) = Lip{xt) ^ 2M\t\Lip[Zt) + (1 + 2M\t\)Lip{duo)Lip{Zt) 

^ 4M|t| + Lip{duo) + Lip{duo){4M\t\{l + Lip{duo))) + 4:M\t\Lip{duo) 
^ Lip{duo) + 4M|i| (l + Lip{duo)) (l + Lip{duo)) . 

a 



1.1 Exercise : 

Take d = 1, H{t,q,p) = (l/2)p^, and UQ{q) = —q"^, and prove that the C^ solution can't be 
extended beyond t = 1/2. 

2 Convexity, the twist property, and the generating function. 

We make an additional assumption on H. Once again, we make the assumption in a stronger 
form than would be necessary, this allows to obtain simpler statements: 

Hypothesis 2. There exists m > such that 

dppH ^ mid 

for each {t,q,p), in the sense of quadratic forms. 

Let us first study the consequences of this hypothesis on the structure of the flow. 

Proposition 7. There exists a > such that the map p i — > QQ{q,p) is {mt/ 2) -monotone when 
t g]0,(t], in the sense that the inequality 

{Qo{q,v) - Ql{q,p)) • (P'-P) ^ mt\p'-p\y2 

holds for each q G M.'^, each t G [0,cr]. As a consequence, it is a C^ diffeomorphism onto R.'^. 

We say that the flow has the Twist property. 
Proof. Fix a point q and denote by F* the map p i — > Qo{q,p)- We have dF^{p) = dpQQ{q,p). 
In order to estimate this linear map, we recall the variational equation 

dpQ'oix) = d,pH{t, ip'Q{x))dpQiix) + dppHit, ipiix))dpP^ix). 

We deduce that 

dpQUx) - d^ppHit, ipiix)) = dlpH{t, ^l{x))dpQl{x) + d^ppHit, ^l{x)){dpP'^{x) - Id) 

and then that 

\\dpQl{x)-dlpH{t,^l{x))\\^2Mh 

As a consequence, for t ^ a = m/{4:M'^), we have 

dpQo ^ (m - 2M'^t)I ^ {m/2)I 
in the sense of quadratic forms (note that the matrix dpQ^ is not necessarily symmetric). Since 

dpQoix) = I dpQl{x)ds, 
Jo 

we conclude that 

dF\p) = dpQi{q,p) ^ {m/2)Id, 

which means that {dF^{p)z, z) ^ (m/2)|zp for each z € M . This estimate can be integrated, 
and implies the monotony of the map F*: 

{Q\q,p') - Q\q,p)) ■ ip' -P)=(j dpQ\q,p + s{p' - p)) ■ {p' - p)ds\ ■ {p' - p) 

= {dpQ\q,p + s{p' -p))-{p' -p))ds 
Jo 

^ / {m/2)t{p' - p) ■ {p' - p)ds ^ {m/2)t{p' - p) ■ {p' - p). 
Jo 



It is then a classical result that the map F* is a C^ diffeoinorphism, see Proposition 51 in the 
appendix. g 

Corollary 8. The map {t,q,p) i — > {t,q,Qo{q,p)) is a C^ dijfeomorphism from ]0,a[xM.'^ x R^* 
onto its image ]0,(j[xM°' x M'^. 

We denote by /Oo(^;Q'0;'?i) the unique momentum p such that QQ{t,qo, pQ{t,qQ,qi)) = qi. In 
other words, po{t,qo,qi) is the initial momentum p(0) of the unique orbit iqis),p{s)) : [0,t] — > 
R X R of (HS) which satisfies q{0) = qo and q{t) = qi. By the Corollary we just proved, 
the map po is C^. Similarly, we denote by pi{t,qo,qi) the unique momentum p such that 
Qt (i, gi,pi(i, goj fZi)) = Qo- We can equivalently define pi as 

Pi(.t, Qo, Qi) = Poit, Qo, Po{t, Qo, Qi))- 

Considering the geometric initial condition (Fq = {qq} x R^*,i(;o = 0), and the associated 
geometric solution {G,w), we see that 

G = {{t, q, pi{t, qo, q)), {t, q) G]0, cj[xR'^}. 

We conclude from Corollary 6 that there exists a genuine solution of (HJ) emanating from the 
geometric initial condition ({go} x R'^*,0). We denote by S^{qo,q) this solution. We have 

S\qo,Q) = w{t,p,pi{t,qo,q)) 

and 

dqS\qo,q) = pi{t,qo,q). 

In view of the definition of geometric solutions, the function S can be written more explicitly 

S\qo,qi) = / Poiqo,Poit,qo,qi))Qo{Qo,Po{t,qo,qi)) - H{s,ipQ{qo, po{t,qo,qi))ds. 
Jo 

In words, S^{qo, qi) is the action of the unique trajectory {q{s),p{s)) : [0, t] — > R^ x R'^* of (HS) 
which satisfies q{0) = qo and q{t) = qi. 

We have defined the function S^{qo,qi) as the action of the unique orbit joining go and 
qi between time and t. We can define similarly the function S!,.{qo,qi) as the action of the 
unique orbit joining qo to qi between time r and time t, all this being well-defined provided 
< t — r < cj. It is possible to prove as above that the function (s, q) i — > Sl{q, qi) solves the 
Hamilton-Jacobi equation 

dsU + H{t, q, -dqu) = 0, 

on s < t, and that 

dqS\q, qi) = dqSoiq, qi) = -po{t, q, qi)- 

Convention: We shall from now on denote by doS* the partial differential with respect to 
the first variable (which in our notations is often qo), and by 9i5* the partial differential with 
respect to the second variable (which in our notations is often qi). 

The relations doS = —po, diS = pi, dtS = —H{t, qi, pi) = —H{0, qo, po) that we have proved 
imply that the function S is C^. Moreover, since ^o[qo-, Po{t-,Qo,Qi)) = {qi, Pi{t,Qo,Qi), we have 

'Po{Qo,-doS{qo,qi)) = {qi,diS\qo,qi)). 

We say that S^ is a generating function of the flow map ipQ. See [ ], chapter 9, for more 
material on generating functions. It is useful to estimate the second differentials of S: 
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Lemma 9. The function S is C^ on ]0,o"[xM'^ x M'', and the estimates 

hold, with constants c and C which depend only on m and M . 
Proof. Let us first observe that 

diiS\qG,qi) = {dpPQ{qo,Po{t,qo,qi)){dpQQ{qo,po{t,qo,qi)))~ , 
and recall the estimates: 

||6>pPo* - Id\\ ^ 2Mt, WdpQlW ^ 2Mt, dpQl ^ {mt/2)Id. 
We conclude that (see Lemma 52) 



^^vQoY'^^^Id , \\idpQl)-'\\^2/imt). 



Finally, we obtain that 



r^9 ^/ ^ f m 4M\ ^ , rn ^ , 



provided t ^ m^/(64M^). The other estimates can be proved similarly, using the expressions 

dioS\qo,qi) = -{dpPtiqi, pi{t,qo,qi)){dpQ^{qi, pi{t,qo,qi))) , 
dwS\qo,qi) = {dpQl{qo, po{t,qo,po)))~ . 

n 

Proposition 10. Given times ti and t2 such that < ti < t2 < cr, we have the triangle 
inequality 

Sl\qo,q2) ^ S',^{qo,qi) + Sl'^{quq2) 

for each qo,qi,q2- Moreover, SQ^{qo,q2) = min^ {Sl''{qo,q) + Sll{q,q2)). 
Proof. Let us consider the map 

q^f{q) = Sl'[q^,q) + S\l{q,q2). 

We have d^/ ^ 2c hence the map / is convex. Now let us denote by {q{s),p[s)) : [0,^2] — > 
M X M the unique orbit which satisfies g(0) = qo and 9(^2) = 92- We can compute 

df{q{ti)) = diSJ^{qo,q{ti)) + doSll{qit,),q2) = p{ti) - p{ti) = 0. 

The point q{ti) is thus a critical point of the convex function /, hence it is a minimum of this 
function. We conclude that 

S'o'iqo,q)+Sll{q,q2) > S',^ {qo,q{ti)) + Sll{qit,),q2) = 5*^(^0,92) 

for all q. q 

Under the convexity hypothesis 2, Theorem 1 can be extended to C^ solutions: 
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Theorem 3. Let il C M x M be an open set, and let u{t, q) : Q, — > M. be a C^ solution of the 
Hamilton Jacobi equation (HJ). Let q{t) : [to,ti] — > M'^ be a C^ curve such that {t,q{t)) G Q 
and 

q{t)=dpH{q{t),dqu{t,q{t))) 

for each t G [to,ii]- Then, setting p{t) = dqu{t,q{t)), the curve {q{t),p{t)) solves (HS). 

Proof. As in the proof of Theorem 1, we consider a variation q{t,s) = q{t) + s9{t) of q{t), 
where 9 is smooth and vanishes on the endpoints. We choose the vertical variation p(t, s) in 
such a way that the equation 

q{t, s) = dpH{t, q{t, s),p{t, s)) 

holds. The map p{t, s) defined by this relation is differentiable in s, because q and q are and 
because the matrix dlpH is invertible. It is also useful to consider the other vertical variation 

P{t,s):=dqu{t,q{t,s)). 

Our hypothesis is that q{t) = dpH{t,q{t),p{t)), which is the first part of (HS). We start as in 
the proof of Theorem 1 with the following equality: 



ds 



p{t, s) ■ q{t, s) - H{t, q{t, s),p(t, s))dt ] = 0. (2) 

=0 \Jto 



We deduce this equality from the observation that s = is a local minimum of the function 

'to 
This claim follows from the equality 

"ti 

'to 
which holds for all s, and from the inequality 

rti 

'to 
which results, in view of the convexity of H, from the computation 



F(s) := / ' pit, s) ■ q{t, s) - H{t, q{t, s),p{t, s))dt. 
■J to 

he equality 

F(0) = u{tuq{ti)) - uito, qito)) = [ ' P(t, s) ■ (?(t, s) - Hit, q{t, s),P{t, s))ds, 

Jto 

and from the inequality 
F{s) ^ I ' P{t, s) ■ q{t, s) - Hit, q{t, s),P{t, s))ds 

Jto 



H{t, q{t, s), Pit, s)) ^ {P{t, s) - Pit, s)) ■ dpHit, qit, s),p(t, s)) + Hit, qit, s),p(t, s)) 
^ (P(t, s) - Pit, s)) ■ qit, s) + Hit, qit, s),p(t, s)). 

We have proved (2). As in the proof of Theorem 1, we develop the left hand side and, after a 
simplification, we get 

ii 

pit) ■ Bit) - dqHit, qit), pit)) ■ Bit) dt = 0. 
to 

In other words, we have proved that pit) = dqHit, qit), pit)) in the sense of distributions. Since 
the right hand side is continuous, p is C^ and the equality holds in the genuine sense. q 

As in the C"^ case, we have the following corollary, see [12]: 
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Corollary 11. Let u{t,q) :]to,ti[xM.'^ — ;• M. be a C^ solution of (HJ). Then, for each s and t 
in ]tQ,ti[ we have 

where Fj is defined by 

rt:={{q,dut(q)):qeR''}. 

Proof. This corollary follows from Theorem 3 in the same way as Corollary 3 follows from 
Theorem 1. The only difference here is that the map 

F{t,q) ■.= dpH{t,q,dgu{t,q)) 

is only continuous. By the Cauchy-Peano Theorem, this is sufficient to imply the existence of so- 
lutions to the associated differential equation, which is what we need to develop the argument, q 

A last property of the functions S will be useful. Assume that we are considering a family 
H^, /i G / of Hamiltonians, where I C M is an interval, such that the whole function -ff(/i, t, q,p) 
is C^ and such that each of the Hamiltonians H^ satisfy our hypotheses 1 and 2, with uniform 
constants m and M. Then, for each value of /i, we have the function S^{n]qo,qi), which is 
defined for t G]0,a], the bound o" > being independent of /x. Since everything we have done 
so far was based on the local inversion theorem, the function S^{fi;qo,qi) is C^ in fi, or more 
precisely the function (/^, t, Q'O) 9i) ' — > S^{i^]QOtQi) is C^. Moreover, a computation similar to 
the proof of Proposition 1 yields 

d^S\n;qo,qi) = - / d^Hf,{s,q{^i,s),p{fi,s))ds, 
Jo 

where s i — > (g(/x, s),p(;U, s)) is the only ff^-trajectory satisfying g(/i, 0) = go and q{fJ,,t) = qi. 
We can exploit this remark when H^ is the linear interpolation H^ = Hq + fi{Hi — Hq) between 
two Hamiltonians Hq and Hi, and conclude the important monotony property: 

HoS^Hi =^ S\0;q,q')^ S\l;q,q'). (Monotone) 

2.1 Exercise : 

If H{t, q,p) = h{p) is a function of p, then 

S\qo,qi)=th*^'^' 



t 
where h* is the Legendre transform of h. As an example, when H{t, q,p) = a\p\'^/2, then 

S\qo,qi) = ;r— ki -qo\^- 
Zta 

3 Extension of the generating function: The minimal action. 

A classical problem consists in finding an orbit {q{t),p{t)) of the Hamiltonian system such that 
Qito) = Qo and q{ti) = qi, for given [to;^i] C M, qo,qi G M*^. We have seen, under Hypotheses 1 
and 2, that this problem has a unique solution provided to < ^i < ^o + C) where o" is a constant 
depending only on m an M. The situation is more subtle for larger values of ti — to- In order 
to study it, it is useful to consider the function 

where we have taken to = and ti = t to simplify notations, and where n is an integer such 
that t/n ^ a. The critical points of & are in one to one correspondence with the solutions of 
our problem: 
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Lemma 12. The point {9i, . . . ,9n-i) is a critical point of & if and only if there exists an 
orbit {q(s),p{s)) : [0, t] — > W^ x W^* such that q{0) = qo, q{t) = qi, and q{it/n) = 6i for 
i = l,...,n— 1. This orbit is then unique, and its action is <3{9i, . . . , 9n-i)- 

Proof. Let {q{s),p{s)) be the piecewise orbit defined on [it/n, (i + l)t/n] by the constraints 
q{it/n) = 9i and q{{i + l)t/n) = Oi+i. The action of this piecewise orbit is ©(^i, • • • ,6'„_i). The 
statement follows from the simple computation 

de,& = diS'l^{9i^iA) + doS'/'^{9^,9i+i) = p- [it/n) - p+(it/n). 

u 

Using this finite dimensional variational functional is usually called the method of broken 
geodesies, see [0]. The function © can be minimized under additional assumptions, for example: 



Hypothesis 3. 



m M 

-\p\^ -M^ H{t,q,p) ^ — |p|2 + M. 



By exploiting the monotony property (Monotone), this hypothesis implies that 

" Mt^S\qo,qi)^-—\qi-qo\^ + Mt, 



\Qi 



and then that 

6(^1, . . . , On-l) ^ ^(1^1 - 90|' + 1^2 - ^l|' + • • • + kl - 0n-l|') - Mt. 

As a consequence, the function 6 is coercive and C^, hence it has a minimum. Notice that, 
although © is convex separately in each of its variables, it is not jointly convex. It can have 
critical points which are not minima, and it can have several different minima. We denote by 
A^ the value function 

A\q^, q,) = min © = min {S',^''{qo, 9,) + Sf/j'{9^, 62) + 5;„_i),/„(0„_i, ft)) (A) 

where n is any integer such that t/n < a. The functions A^(go, 9i) are defined similarly for each 
t ^ T. This notation is legitimate in view of the following: 

Lemma 13. The value of A^ does not depend on n provided t/n < a. Moreover, we have 

J^^kl-qo\'-Mt^A\qo,q^)^^\q,-qonMt. 

This statement implies that A^ = S* when t < a : A^ can be seen as an extension of 5* 
beyond t = a. 

Proof. Since we have not yet proved the independence of n, we temporarily denote by 
A^{qo, qi',n) the value of the minimum. We have 



A\qQ,qi;n)^ min (-^(|0i - goP + • • ' + ki - ^n-iP) - Mi) 
\qi - gol^ - Mt. 



2Mr 

lit < a, then the equality S^{qo, qi) = A^{qQ, qi;n) can be proved by recurrence for each n using 
Proposition 10. For general t, let us prove that A^{n) is independent of n. We take two integers 
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n and m such that t/n < a, t/m < a and want to prove that A^in) = A^{m). We wih prove that 
A^{n) = A^{nm) = A^{m). Since t/m < a, we have 

Al+'/^{qo,qi;n) = S;+'/"'{qo,qi) 
for each r and n, hence 

A\qo, qv, nm)= min [^^""^(go, ^i) + 4*^7(^1' ^2) + • • • + ^f^™ ),/„^(^n-i, &.) 

Q(n+l)i/m"//i a A , , c.2i/m , r. n ^ 

+ ••• 

C'(m-l)t/m+i/nm('/i /i ^ i _i_ Q* ^/^ r, \ 



mm 

62n,d3n,---,9(m-l)n - 

A\qo,qi;m). 



Sq (go, ^n) + 5'^/^ (^'n, 6'2n) H h 5'(m-l)t/m(^(™-l)"' ^^ 



We have proved that A*{nm) = A^{m), by symmetry we also have A^{nm) = yl*(n) hence 
74*(n) = A^^m). FinaUy, we have 

6(^1, . . . , a„_i) ^ TT^d^i - gol' + \02 -0i\^ + \qi - ^n-ll') + Mt 
2mt ' 

hence 

A*(go,gi)^ min -^(|ei-go|^ + |^2-^i|^ + ki-en-i|^)+Mt 

'qi-qo\'^ + Mt. 



2mt 



U 
The following property concerning A follows easily from the definition : 

4^(go,g2) =min«(go,gi) + 4?(9i,g2)), (T) 

when ^ to ^ ^1 ^ ^2- The following consequence of Hypothesis 3 will also be useful: 
Lemma 14. 

Tfi 

p ■ dpH{t, q,p) - H{t, q,p) ^ —H{t, q,p) - (m + M). 
Proof. We deduce from Hypothesis 2 that 



H{t, q, 0) ^ H{t, q,p)-p- dpH{t, q,p) + ^|p|2. 



We deduce that 



p . dpHit,q,p) - H{t,q,p) ^ "^IpI^ - H{t,q,0) ^ ^iH{t,q,p) - M) - M 



a 



The minimal action A^{qo,qi) is not necessarily C^, we need some definitions before we can 
study its regularity. The linear form / is called a X-super-differential of the function u at point 
q if the inequality 

u{9) ^ u{q) + l{9 -q) + K\e - q\^ 
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holds in a neighborhood of q. The Unear form / is a proximal super-differential of u at point q 
if it is a X-super-differential for some K. The form / is a proximal super-differential of u at (7 if 
and only if there exists a C^ function v such that dv{q) = I and such that the difference v — u 
has a minimum at q. More generally, we will say that I is a super-differential of n at g if there 
exists a C^ function v such that dv{q) = I and such that the difference v — u has a minimum at 
g. A super-differential is not necessarily a proximal super-differential. 

A function u : MJ^ — > M is called ET-semi-concave if it admits a iC-super-differential at each 
point. It is equivalent to require that the function 9 1 — > u{9) — K\6\'^ is concave. A function is 
called semi-concave if it is if-semi-concave for some K. If n is a ET-semi-concave function, and 
if / is a super-differential at n, then the inequality 

u{9) ^ u{q) + l{9 -q) + K\9 - q\'^ 

holds for each 9. In particular, / is a iC-super-differential. 

Lemma 15. The function A^ is C(l + \/t)- semi- concave, with some constant C which depends 
only on m and M . 

Proof. Let us first assume that t €]0,(t[. In this case, A\^ = 5q, this function is C^ and its 
second derivative was estimated in Lemma 9. Let us now assume that t ^ a. Then, there exists 
n G N such that t/n £ [a/3,a/2[. We have 

Aliq, q') = mill (^^"(g, 9) + A\-f\e, 9') + Sl,/^{9' , q')) . 

Considering a minimizing pair {9o,6i) in the expression above at {qo^Qi), we see that the C^ 
function 

{q, q') ^ S'tiq, 0o) + 4"„*/"(^o, ^1) + C,/„(^i, ?') 

is touching from above the function Aq at point {qo,qi)- In view of Lemma 9, this provides a 
uniform (for t ^ a) semi-concavity constant for Aq. q 



4 The Lax-Oleinik operators. 

Given to < ti, we define the Lax-Oleinik operators T^^^ and T^" which, to each function u : 
R*^ — ;■ M associate the functions 

Tllu{q):=ml{u{9)+A'-{9,q)) , t*>(g) := sup (n(e) - A*J(g, ^)). 



We have the Markov (or semi-group) property: 



'T'*2 _ rpti r-pt2 Hpto ^ Hptl qpto 



t2 

for to < ii < *2- Note however that T^J o tJ° and TJ° o T^^l^ are not the identity. Concerning 
these operators, we only have the inequalities 

'i\loT\l{u)^u , T*;ot*;(n)^n, 

the easy proof of which is left to the reader. Each property concerning the Lax-Oleinik operator 
T has a counterpart for the dual operator T, that we will not always bother to state, but 
never hesitate to use. The family of operators T^J is characterized by the fact that Tjjn(g') = 
infg {u{9) + S^^{qo,qi)) when to ^ ti ^ to + a and by the Markov property. The Lax-Oleinik 
operators solve (HJ) in various important ways, that will be detailed in the present section. It 
is useful first to settle some regularity issues. 
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Lemma 16. There exists a constant C , depending only on m and M such that, for each t g]0, a], 
the function T*u is {C /t)- semi- concave provided it is finite at each point. 

Proof. The function T*ti is the infimum of the functions / = u{9) + S^{9, .), which are C^ with 
the uniform bound ||d'^/|| ^ C /t. It is then an easy exercise to conclude that the function T^u 
is C/t-semi-concave, see Lemma 54. q 

Given an arbitrary function uq, the infimum in the definition of TqUq is not necessarily finite, 
and, even if it is finite, it is not necessarily a minimum. It is clear from Proposition 13 that the 
infimum is a finite minimum under the assumption that uq is continuous and Lipschitz in the 
Large, which means that there exists a constant k such that 

uo{q) - Uo{q) ^ k{l + \q - q\) 

for each q and q' . 

Lemma 17. // uq is Lipschitz in the large, then so are the functions TqUq for all t ^ 0. 

The function {t,q) i — > u{t,q) = TqUq^q) is locally semi- concave, hence locally Lipschitz on 

]0, oo) X W^. The function u solves (HJ) at all its points of differentiability (hence almost 
everywhere). 

Proof. Since uq is Lipschitz in the large, the function TqUq — uq is bounded for each t > 0, as 
follows from the inequalities 

inf {uo{q) -k-k\e-q\+ S\9, q)) ^ T*Uo ^ Uo{q) + S\q, q) 
6 

which imply (setting A = 9 — q) that 

inf {-k- k\A\ + -^|A|2 - tM) ^ %uo{q) - uo{q) ^ ML 

We conclude that the function TqUq = (TqUq — no) + no is Lipschitz in the large. In the 
computations above, we also see that the infimum can be taken on |A| ^ K, where K \s a. 
constant independent from q. 

Let us now prove that the function u{t,q) := TQno((?) is locally Lipschitz on t > 0. In view 
of the Markov property, it is enough to prove that the function u is Lipschitz on ]r, a/2[xB for 
each closed ball B C M.'^ and each time r G]0,cr/2[. Since u{q) is Lipschitz in the large, there 
exists a radius R > such that 

u(t,q) = inf uie) + S\9,q) 

for (t, q) e]r, a/2[xB. Since S is C^, the functions (t, q) i — > u{9)-\-S^{6, q), \9\ ^ R have uniform 
C^ bounds on ]T,a/2[xB. Their infimum u{t,q) is then semi-concave, hence Lipschitz on that 
set, see Lemma 54. 

Finally, let {t,q) be a point of differentiability of u, and let r G]max(0,t — cr),t[ be given. 
Since Ur is Lipschitz in the large and locally Lipschitz, there exists 9 such that T^^Ur{q) = 
Ut{9) + S!;.{9,q). For a different point {s,y), we have T^Ur{y) ^ Ur{9) + S^{9,y), hence the 
function (s, y) i — > u{s,y) — S^{9,y) has a maximum at {t,q), which implies that the functions 
u{s,y) and S^{9,y), each of which is differentiable at {t,q), have the same differential at {t,q). 
Since the functions {s,y) i — > S^{9,y) solves (HJ), the function u also solves (HJ) at {t,q). q 

Let us now establish the relation of our operators with regular solutions. 
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Proposition 18. Let u{t,q) ■]to,ti[x]S.'^ — >• M. be a C^ solution of HJ, then T^itr = ut and 
TfUt = Ur for each t ^t in ]to,ti[. The function u is locally C^'^. 

This property is one of the main motivations to introduce the Lax-Oleinik operators. The 
observation that C^ solutions are actually locally C^'^ comes Fathi's paper [__'], itself inspired 
by anterior works of Herman. Another consequence of this Theorem is that uniqueness extends 
to C^ solutions under the convexity assumption. 

Proof. In view of the Markov property, it is enough to prove the result for < t — t < a. 
Given q and 9 in T'^, we consider the unique orbit {q{s),p{s)) such that g(r) = 6 and q{t) = q. 
By the convexity oi H, we have 

H{q{s), dqu{s, q{s))) ^ H{q{s),p{s)) + {dgu{s, q{s)) - p{s)) ■ dpH{s, q{s),p{s)). 

Noticing that q{s) = dpH{s,q{s),p{s)) and integrating gives: 

SUe,q)= I p{s)-q{s)-H{s,q{s),p{s))ds 



> / dgu{s,q{s)) ■ q{s) - H{s,q{s),dgu{s,q{s)))ds 

= u{t,q) -u{T,e), 

with equality if p(s) = dgu{s,q{s)) for each s. We conclude that 

Tiuriq) ^ ut{q), 

with equality if there exists an orbit {q{s),p{s)) : [r,i] — ;■ M'^ x M'^* such that p(s) = dqu{s,q{s)) 
and q{t) = q. By Corollary 11, the orbit of the point {q,dgu{t,q)) satisfies this property, hence 
the equality holds. 

To prove the regularity of u we consider a subinterval [toi^i] C]toi*i[i and prove that u is 
locally C^'^ on ]to5^i[- We have 

uit,q)=Tlu-,^^{q)= t*in,-^(g) 

for each t €]tQ,ti[. If the functions ut were Lipschitz in the Large, we could apply Lemma 
17 and deduce that u is both locally semi-concave and locally semi-convex, hence locally C^'^, 
on Jtoj^iixK"^. Here we do not make any growth assumption, so we need a slightly differ- 
ent argument to prove the semi-concavity of u (and, similarly, its semi-convexity). We have 
seen that the infimum in the definition T^ u^ (q) is a minimum, which is attained at the point 

9 = Qt'iq, dgu{t, q)). This gives us an a priori bound on 6, and we can continue the proof as in 
Lemma 17. q 

Let us sum up some properties of the Lax-Oleinik operators T^ associated to a Hamiltonian 
satisfying hypotheses 1,2,3: 

Property 19. 

1. Markov property: T* o T^ = T^ when t ^ s ^ t. 

2. Monotony: u ^ v ^ T^u ^ T^-V for each t ^ t. 

3. Compatibility with (HJ): Ifu{t, q) :]toi *i [xR'^ — > M. is aC"^ solution of (HJ), then T^n^ = 
Ut when to < t < t < ti. 
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4- Boundedness: If Ut is Lipschitz in the large, then the functions T^Ur, t G [t,T] are 
uniformly Lipschitz in the large for each T ^ t. 

5. Regularity: Ifur is Lipschitz in the large, the function (t, q) i — > T^UT-(g) is locally Lipschitz 
on ]t, oo) X W^. 

6. Translation invariance: T^(c + u) = c + T\.u for each constant c G M. 

The Lax-Oleinik operators solve the Cauchy problem for (HJ) in the viscosity sense. Actually, 
this follows from Property 19: 

Proposition 20. Let H be a Hamiltonian satisfying Hypothesis 1. Assume that there exists a 
family T\, ^ t ^ t of operators satisfying the Markov property, the monotony, the compatibility 
with (HJ), and the boundedness as expressed in Property 19. Then if uq is an initial condition 
which is Lipschitz in the large, the function 

{t,q)^^u{t,q) = %Uo{q) 
is a viscosity solution of (HJ) on ]0, oo) x M.'^. 

Notice that we did not make any convexity assumption. This kind of axiomatic characteri- 
zation of viscosity solutions is reminiscent from [.], see also [S]. It may also help to understand 
the links between viscosity solutions and variational solutions in the non-convex setting. Such 
links were suggested by Claude Viterbo and established in her thesis by Qiaolin Wei, [20]. 

Proof of Proposition 20: Let us prove that u is a viscosity sub-solution, a similar proof 
yields that it is also a super-solution. We consider a point {T,Q) g]0,oo) x M'' and a super- 
differential {h,p) of the function u at (T, Q). To prove that h + H{T, Q,p) ^ 0, we assume, by 
contradiction, that 

h + H{T,Q,p) >0. 

As is usual for viscosity solutions we will use a test function (j). We will assume that (j) '■ KxM'^ — > 
M is smooth and satisfies the following properties: 

. (/.(T, Q) = u{T, Q) , dt(l){T, Q) = h, dqckiT, Q) = p, 

• 4>^uon [-T/2,2T] xR'^, 

• There exists a constant C > such that 4>{t,q) = C-y/l + \q\'^ when |g| + \t\ ^ C. 

Note that d'^cj) is bounded. Such a test function exists because the functions ut, t G [T/2,2T], 

are uniformly Lipschitz in the large, as follows from the boundedness property assumed on the 

operators. 

Claim: There exists S > and a C"^ function w{t, t, q) defined on the open set 

{{T,t,q) eRxM.xR'^:T-S<t<T + S}cM.xRxR'^ 

such that, for each fixed r, the function Wr '■ {t,Q) ' — > w{T,t,q) is the solution of the Cauchy 
problem 

' dtWr + H{t, q, dqWr) = 

Wr{T,q) =(j){T,q). 

The existence of a solution Wr to this problem follows from Theorem 2. However, to see that w 
is C^ in all its variables, we find it more convenient to consider the Cauchy problem 



dgU + ( dzU + H{z, q, dqu{s, z, q))) =0 
u{0,z,q) = (l){z,q). 



19 



By Theorem 2, applied to the Hamiltonian 

H{s,z,q,^,p) :Rx (RxM'^) X (R x R'^)* — >R 

{s,z,q,^,p) I — > i + H{z,q,p) 

there exists S > and a C^ solution n(s, z, q) :] — 5, ^[xR x R'^ — > R of this Cauchy problem. 
Setting 

w{T,t,q) := u{t-T,t,q), 

we verify that 

dtw{t, q) + H{t, q, dgw{t, q)) = dsu{t - r, t, q) + dzu{t - r, t, q) + H{t, q, dqu{t - r, t, q)) = 

and that w{t, t, q) = u(0, r, g) = (/)(r, (7). 

Claim : There exists r g]T — 5, T[ such that i(;(r, T, Q) < (p{T, Q). 
Since w(T, T, g) = 0(T, q), we have 

5it/;(T, T, Q) = -H{T, Q, dgw{T, Q)) = -H{T, Q, dgcp{T, Q)) < dt<P{T, Q). 

As a consequence, there exists (5 > such that 

dtw{T,t,Q)-dt>p{t,Q)<Q 

for r, t £]T — 5, r[. Since w{t, t, Q) = <J){t, Q), we deduce by integration that 

w{t, T, Q) - (t>{T, Q)= I dtw{T, t, Q) - dt(t>{t, Q)dt < 

provided r ^]T — 6,T[, which proves our claim. 

Conclusion : Since we are considering monotone operators compatible with (HJ) we have 

w{t,T,Q) = T'^WriQ) = T'^MQ) ^ T^rMQ) = <T,Q) 
hence (/<(T, Q) > u(T, Q), which is a contradiction. q 

This parenthesis through viscosity solutions being closed, let us turn our attention to more 
geometric aspects of the Lax-Oleinik operators. We denote by r„ the graph of the differential 
of u on its domain of definition, 

^u '■= {{(l-,du{q)) : g € R , du{q) exists} . 

Proposition 21. Let u be a semi-concave and Lipschitz function. The set 

is contained in Tu for each t > 0, and it is a Lipschitz graph. 

Proof. In view of the Markov property, it is enough to prove the result for t g]0, a]. Let {q,p) be 
a point of Trj.t^, which means that the function TqU is differentiable at q and that d{TQu){q) = p. 
Let be a minimizing point in the expression TQu(g) = ming u{9) + Sq{0, q). Since each of the 
functions u and S'o(.,g) are semi-concave, this implies that they are both differentiable at 0, 
and that du{Q) + 9o5'o(®''?) ~ ^- Moreover, this implies that the function u{@) + Sq{@,.) 
touches the function TqU from above at point q, hence that Sq{@, .) is differentiable at q, with 
a differential equal to p. We then have 

^Uq.p) = ip't{q,diS'oi&,q)) = (e,-9oS*(e,g) = {e,du{e)) c r„. 
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We have proved that ^t(XT^u) ^ ^u- Moreover, we have Qi(rxiu) C I, where X C M'' is the 
set of points 9 which are minimizing in the definition of T^u^q) for some point q. 
Claim: The function u is C^'^ on X. This means that u is differentiable at each point of X, and 
that the map 6 i — > du{6) is Lipschitz on X. In other words, the projection of F^ to W^ contains 
X, and the set 

T^\x-={{o,du{e),e^x] 

is a Lipschitz graph. 

To prove the claim, we first prove that u has C-super-differentials and C-sub-differentials at 
each point of X, where C is a common semi-concavity constant of all the functions — S'q(., g) and 
of the function u. The existence of a C-super-differential follows from the C-semi-concavity of u. 
To prove the existence of a C-sub-differential at a point G G X, we consider a point q such that 
u{Q) + 5*0(0, q) = TQu{q). Such a point exists by definition of X. This implies that the function 
9 I — > u{9) + SQ{9,q) has a minimum at 6 = Q, hence each C-sub-differential of — 5Q(.,g) is a 
C-sub-differential of u. The claim then follows from a result of Fathi, see Proposition 53 in the 
Appendix. 

Let now {q,p) be a point in the closure Fr^t^ of Fr^t^. There exists a sequence {qn,Pn) of 
points of Frpt„ which converges to {q,p). By definition, the function T^u is differentiable at qn, 
and pn = d{TQu){qn)- Let 0^ = Qt{Qn,Pn) be the sequence of points such that 

T*'u(g„) = -^(0^) + 5^(0„, qn). 

The sequence 0„ is converging to = Qf{q,p), and, at the limit, we see that 

T*n(g)=n(0)+5*(0,g). 

We conclude that G X. Since we have already proved the Lipschitz regularity of du on X, we 
deduce that ^Pt{q,p) = liin{^'l {qn,Pn)) = lim(0„,du(0n)) = (0,ciM(0)) G F^p C F„. □ 

The action of the Lax-Oleinik operators on semi-convex functions also has a remarkable 
property, see [4]. It is useful to denote by L^ the set of point {Q,P) such that P is a sub- 
differential of u at Q. Note that F„ C L„. 

Proposition 22. If u is K -semi-convex, then for each 6 G]0, 1[ there exists T > such that 
TqU is {K + 6) -semi-convex, hence C^'^ , for each t g]0, T]. One can take 



2M(3 + 2ir)2' 
Proof. Since u is ii'-semi-convex, for each {Q,P) G L^, we have 

<q) ^ u{Q) + P{q -Q)- K\q - Q^. 
We denote by lQ,p{q) the function on the right in this inequality, so that 

u = max In p. 

{Q,P)&Lu 

Taking T as in the statement, it follows from Theorem 2 that the functions Tq(/q^p), t G [—T, T] 
are C^ with a second derivative bounded by 2K + 4iM(l + 2Kf ^ 2K + 26. We claim that 

T*n= max T*(/q,p), 
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for t e [0, T] n [0, a], which imphes that Tq-u is {K + 4tM(l + 2_fC)^)-semi-convex. We prove the 
claim in two steps. First, the inequahty 

T*on^ max T*o(/q,p) 

follows immediately from the fact that u ^ Iq^p for each (Q, P) € L in view of the monotony 
of Tq, see Property 19. Let us fix a point (t,q) and prove the converse inequality at this point. 
Since 

uie) + SHe, q) ^ u{q) + P{e -q)- K{e -qf + ^\e- g|2 - tM 

and since K ^ l/2tM, there exists a point 6 such that Tgu(g) = u[9) + Sq{9^ q). Assuming that 
t ^ a, this implies that the point {9, Q = [9, —808^(9, q)) belongs to L^, and that q = Qq{9, Q. 
Then, we have 

T^likdiQ) = h,m + Si{9, q) = u{9) + Sl{9, q) = %u{q) 

hence 

T*tx(g)^ max T*(/q,p)((z) 
(Q,P)eL 

provided t ^ a. We conclude that TqU is semi-concave with constant K + 2tM{l + 2K)'^ for 
t £ [0, a] n [0, T]. We can then apply this result to Tf^n, and, since K + tM{l + 2K)^ i^K + 1, 
we conclude that the function T^TqU is semi-concave with constant 

K + 2aM(l + 2Kf + 2tM{3 + 2Kf i^K + 2[cj + t)M{3 + 2Kf i^ K + 1 

for t G [0, a] D [0,T — a]. In other words, the functions TqM are semi-concave with constant 
K + 2tM(3 -|- 2K)^ for t G [0,2(t] n [0,r]. We can apply this argument as many times as 
necessary and obtain that, the functions TqU are semi-concave with constant K + 2tM(3 + 2K)'^ 
for each t £ [0,T]. q 

The following was first stated explicitly by Marie-Claude Arnaud in [ ]. 

Addendum 1. Under the hypotheses of Proposition 22, we have Lu = ^ti^T^u) f^'^ each 
t £]0,T[. Moreover, for each q, we have T^ti(g) = u{9) + S^Q{0,q), with 9 = Q^{q,d{Tlu){q)). 

Proof. For each q G M*^, we have seen that there exists (^, C) £ -^m such that TQu{q) = 
u{9) + Sq{9, q) and C = —doSl{9, q). Since we know that TqU is C^, the first of these equalities 
implies that d(TQu){q) = (9i5q(0, q), while the second implies that (Pq{9, Q = {q, 9iS'o(6', q)). We 
conclude that ^ti^T'^u) '^ ^u- Moreover, = Ql{q,d{TQu){q)). 

Conversely, let us consider a point {9, () £ L, and denote by I the associated function /g^^. By 
Proposition 18, the function {t,q) 1 — > TQ/(g) is the restriction to ]0,T[xM'^ of the C^ solution 
of (HJ) emanating from /. As a consequence, we have 

T'oKQUO, 0) = m + S'oi9, Qii9, 0) = ui9) + 5*(9, Qli9, ()) ^ T*n(Q* (0, C)). 

Since we know from the monotony property that Tq/ ^ TqM, we conclude that this last inequality 
is actually an equality. Setting qi = Qq{9, (), this implies that 

{9,0 = (0,-ao5*(0,gi)) = (^0(<?i,9i5*(e,gi)) = (^0(gi,(iT*n((7i)) c v^'tO^TlJ- 

We conclude that L^ C ipf{Trj,t^). q 

Addendum 2. Under the hypotheses of Proposition 22, we have T^oTqU = u for each t g]0, T[. 
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Proof. Let us define the map F : q i — > Qf{q,d{TQu{q)). By the first addendum, the image of 
F is equal to the projection of L^ on W^, hence the map F is onto. Given a point 6 G M'^, we 
consider a preimage g of by F, and write 



T^,oTlu{e)^%u{q)-S'oi(^,q)=u{d) 



where the last equality comes from the first addendum. We conclude that T^ o TqU ^ u, hence 

to o T* w = u. □ 



The following extrapolates on [ ]. For to S M and 5,t > 0, let us define the operators 

Theorem 4. There exists 6 e]0, 1[, which depends only on m and M such that the operators 
R*, R* have the following properties: 

• For each to £ M. and t g]0, 1[, the finite valued functions in the images of R* and R* are 
uniformly C^'^ . 

• For each semi-concave function u, there exists T > such that R*u ^ u and R*u ^ u for 
each to e M and t e]0,T[. 

• For each semi-convex function u, there exists T > such that R*n ^ u and R*u ^ u for 
each to e M andt G]0,r[. 

• For each C^'^ function u, there exists T > such that R*n = u and R*n = u for each 
to eM andte]0,T[. 

Proof. The finite valued functions in the image of T^"^ are C/t-semi-concave, by Lemma 16 
(we assume that t g]0, 1[). Then, by Proposition 22, the finite valued functions in the image of 
'^t'+st ° ^to-t ^^^ (2C/t)-semi-concave provided 

C Ct 

5t< 



tM(3 + 2C/t)2 M(3t + 2C)2' 

which holds it 5 ^ C/(M(3 + 2C)). For such a 6, the finite valued functions in the image of R* 
are uniformly semi-concave. They are also uniformly semi-convex, hence uniformly C^'^. The 
proof is similar for R. Let us now write 

R*:=(t*^+,,oT*«+^*)o(T*^,ot*;;-*), 

which implies, using the monotony, that B}u ^ T^+st ° TjJ]+^*u and R*m ^ T^°_j o t^JJ"*?/. By 
Addendum 2 we conclude that R*u ^ u for small t when u is semi-convex. All the statements 
of the second and third point follow by similar considerations. The last point follows from the 
second and third one. 
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5 Sub-solutions of the stationary Hamilton-Jacobi equation. 

We assume from now on that the Hamiltonian does not explicitly depend on time. Then, in 
addition to (HJ), we can consider the stationary Hamilton-Jacobi equation 

H{q,du{q)) = a, (HJa) 

23 



for each real parameter a. This stationary equation is the main character of Fathi's joined 
lecture. Formally, a function u{q) solves (HJo,) if and only if the function [t, q) > — > u{q) — at 
solves (HJ). It is not hard to check that this also holds in the sense of viscosity solutions: The 
function u{q) is a viscosity solution of (HJa) if and only if the function (t, q) i — > u{q) — ot is a 
viscosity solution of (HJ). Let us explicit for later references: 

Hypothesis 4. We say that H is autonomous if it does not depend on the time variable. 

In this autonomous context, we have T!J!"'"* = Tq. We will denote by T* this operator. The 
Markov property turns to the equality T*oT'^ = T*+*. In other words, the Lax Oleinik operators 
form a semi-group, the famous Lax-Oleinik semi-group. Another important specificity of the 
autonomous context is that the Hamiltonian H is constant along Hamiltonian orbits, as can be 
checked by an easy computation. 

Proposition 23. Given a Hamiltonian H satisfying Hypotheses 1,2,3,4, the following properties 
are equivalent for a function u: 

1. The function u is Lipschitz and it solves the inequation H{q, du{q)) ^ a almost everywhere. 

2. The inequality u{qi) — u{qo) ^ A^{qQ, qi) + at holds for each qo G M'^, qi € M^, t > 0. 

3. The inequality u ^ T*ii + ta holds for each t ^ 0. 

4. The function u is a viscosity sub-solution of the Hamilton- J acobi equation H{q, du{q)) = a. 

5. The function u is Lipschitz and the inequation H{q,du{q)) ^ a holds at each point of 
differentiability q of u (by Rademacher Theorem, the set of points of differentiability has 
full measure). 

The function u is called a sub-solution at level a, or a sub-solution of (HJa), if it satisfies these 
properties. 

Proof. It is tautological that 5 =^ 1 and easy that 2 <^ 3. Let us prove that 1 =^ 2, 
following Fathi. If 1 holds, then there exists a set M C M of full measure composed of points 
of differentiability q of u such that H{q,du{q)) ^ a. We first assume that t < a and prove 2 
(recall that A* = S**). Let us consider the map 

{qo,qi,T) I — > (g(r),gi,T), 

where (/(r) is the value at time r of the unique orbit {q{s),p{s)) which satisfies q{0) = qo and 
q{t) = qi. This map is a diffeomorphism of W^ x M'^xJO, t[, the inverse diffeomorphism being 

{9,qi,T) I — > {q{0),qi,T), 

where {q{s),p{s)) is the unique orbit such that g(r) = 9 and q{t) = qi. As a consequence, 
for almost each pair {qo,qi), the function u is differentiable at the point q(s) for almost every 
s g]0, t[. li {qo,qi) is such a pair, we have, using the convexity of if in p, 

u{qi) - u{qo) = u{q{t)) - u{q{0)) = / duq(^s) ■ qis)ds = / dug^^y dpH{q{s),p{s))ds 

Jo Jo 



^ / H{q{s),dUg(^,)) + dpH{q{s),p{s))-p{s)-H{q{s),p{s))ds 
Jo 

i^at + S\q{0),q{t)) = at + A\qo, qi). 
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We have proved the desired inequahty for almost every pair (qo, qi), hence on a dense subset of 
pairs. Since both sides of the inequahty are continuous, we deduce that the inequahty holds for 
all pairs {qo,Qi), provided t < a. In order to deduce the inequality when t ^ o", we write, for n 
large enough, 

A\qo,qi) + at= min (5*/"(go,^i) + at/n + • • • + 5*/"(g„_i,gi) + at/n) 

^ min {u{9i) - u{qo) -\ \- u{qi) - u{0n-i)) = u{qi) - u{qo). 



7l,.--,Cn-l 



Let us now prove that 3 =^ 4. Let u be a function satisfying 3. This function then satisfies 2, 
hence it is Lipschitz. We consider a C^ function v{q) which touches u from above at some point 
9, which means that v — u has a global minimum at 9. Since the function u is Lipschitz, we can 
modify v at infinity and assume that it has bounded second differential. Then, there exists a 
C^ solution V{t,q) of (H,J) defined on ] - T,T[xR'^ with T > 0, and such that V{0,q) = v{q). 
For t ^ 0, we have Vt = T^v, by Proposition 18. Since v '^ u, we obtain that 

V{t, q) = T^v{q) ^ T*u(g) ^ u{q) - at 

for t g]0, T[, hence ^^^(O, 9) ^ —a (recall that 9 is the point of contact between u and v). Since 
we know that V solves (HJ), we conclude that 

H{e, dgV{0, 9)) = H{9, dv{9)) ^ a. 

The proof that 4 => 5 is very classical and can be found in Fathi's lecture, but we recall it here 
for completeness. If g is a point of differentiability of n, then du{q) is a super-differential (but 
not necessarily a proximal super-differential) of u at g, hence H{q,du{q)) ^ a. We will now 
prove that the function u is locally Lipschitz. The estimate H{q,du{q)) ^ a , which holds at 
each point of differentiability of u, then implies that it is globally Lipschitz in view of Hypothesis 
3. 

Let B{Q, 1) be a closed ball, of radius one. Let us set r = max^g^i-g 2),ge-B(Q,i)(^(^) ~ ^il))- 
Let A: be a positive number greater that r and such that \p\ ^ k ^ H{q, p) > a for each q. Such 
a k exists by Hypothesis 3. Given q in B{Q, 1), the function 

9^^k\9-q\ -u{9) 

has then a local minimum in the interior of the ball B{Q,2). If this minimum is reached at a 
point qi different from q, then the function v(9) := k\9 — q\ is smooth at qi, and, since w is a 
viscosity sub-solution, we have H(qi,dv{qi)) ^ a, which is in contradiction with the fact that 
1^^(91)1 = k. Hence the minimum must be reached at q, which implies that k\9—q\—u{9) ^ —u{q) 
or equivalently that 

u{9)-u{q) ^ k\9-q\ 

for each 9 £ B{Q, 2) and all q G B{Q, 1). We conclude that u is A:-Lipschitz on B{Q, 1). q 

Corollary 24. If u is a sub-solution of (HJa), then, for each t ^ 0, T*n is a sub-solution of 
(HJa), and so is T*n. 

Proof. The function u is a sub-solution if and only if T^tt -\- as '^ u for each t ^ 0. Applying 
T*, we obtain T*T*u -|- os = T**T*n + as ^ T*n. Since this inequality holds for each s ^ 0, we 
conclude that T*m is a sub-solution. g 

Corollary 25. // the function u is Lipschitz, and if the Hamiltonian is autonomous, then the 
functions T*u, t ^ are equi-Lipschitz. 
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Proof. If the function u is /c-Lipschitz, then du{q) ^ k almost everywhere, hence tt is a 
sub-solution to (HJa) for some a (one can take a = sup\p\^f.H{q,p)). As a consequence, 
the functions T*u, t ^ are all sub-solutions to (HJa), hence they are X-Lipschitz, with 
K = sup{\p\,H{q,p) !^a}. □ 



6 Weak KAM solutions and invariant sets. 

We derive here the first dynamical consequences from the theory. 

Definition 26. The function u is called a Weak KAM solution at level a if T*u + ta = u for 
each t ^ 0. Weak KAM solutions at level a are viscosity solutions of (HJa). We say that the 
function u is a Weak KAM Solution if it is a Weak KAM solution at some level a. 

If M is a weak KAM solution, then it is semi-concave (with a semi-concavity constant which 
depends only on M and m). By Theorem 21, for t > 0, we have the inclusion 

and this set is a Lipschitz graph. The set 

X*(u):=n„eNV'""(f«) 

is a closed invariant set contained in a Lipschitz graph. It would be a very nice result to have 
obtained a distinguished closed invariant subsets of our Hamiltonian system contained in a 
Lipschitz graph. Unfortunately, at this point, we can't prove (because it is not necessarily true) 
that the set I* (u) is not empty. In order to obtain interesting dynamical consequences from this 
theory, we need an additional assumption. 

Hypothesis 5. We say that the Hamiltonian H is periodic if H{q + w,p) = H{q,p) for each 

weZ'^, qeR'^ andp€R'^*. 

Under this hypothesis, we should see the Hamiltonian system as defined on the phase space 
jd ^ jgd*^ ^^^Yi T'^ = M'^/Z'^. Indeed, the flow (/?* commutes with the translations {q,p) i — > {q + 
w,p), w G Z . The compactness of this new configuration space has remarkable consequences, 
summed up in the following Theorem. We assume in the rest of this section that the Hamiltonian 
H satisfies Hypotheses 1, 2, 3, 4, 5. 

Theorem 5. // the Hamiltonian is autonomous and periodic, then there exists a periodic Weak 
KAM solution. The corresponding setX*{u) is a non-empty closed invariant set which is con- 
tained in a Lipschitz graph and which is invariant under the translations {q,p) i — > {q + w^p), 
w eZ'^. 

This last property on the invariance under translations means that T*[u) naturally gives rise 
to an invariant space on the quotient phase space T x M . 

Proof. Let us first prove the second part of the Theorem. If u is a periodic Weak KAM 
solution, then the set F^ is contained in {\p\ ^ C} for some constant C, and it is invariant under 
the integral translations, hence it descends to a compact subset of T'^ x M'^*, that we still denote 
by r^. Then the sets (/?~"'(r„) form a decreasing sequence of non-empty compact sets, hence 
their intersection is a non-empty compact set. 

Let us now prove that there exists a periodic Weak KAM solution. We follow the proof of 
[6], which is slightly different from the original proof of Fathi. Observe first that the functions 
^^{0.0^0.1) are periodic in the sense that j4*(go + w,qi+w) = ^*(goi^i) for each w G l/. This 
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implies that T*ti is periodic when u is periodic. Considering the Cauchy problem for (HJ) with 
initial condition equal to zero, we define v{t,q) := T*0(g'). The quantities a~^(t) = m.a,XgVt{q) 
and a^{t) = mmg vt{q) will be useful. Since the functions vt,t ^ are equi-Lipschitz, there 
exists a constant K such that a~^{t) — o~(i) ^ K for all t ^ 0. We have 

a+{t + s) = maxT*+"0 = maxT*(T"0) ^ T*(a+(s)) = a+{s) + T*(0) ^ a+(s) + a+(t), 

and similarly 

a~{t + s) ^ a'{t) + a'{s). 

By standard results on sub-additive functions, we conclude that a'^{t)/t and a^{t)/t converge 
respectively to infj^ofl''^(^)/^ and sup^^g '3^~(^)/*- Since a"*" — a~ is bounded, these two limits 
have the same value, let us call it —a. We have 

K -ta^ a'it) +K ^ a+(t) ^ -ta ^ a"(t) ^ a+(t) - K ^ K - at 

for all t ^ 0, hence 

K ^ ?;(t, g) + to ^ -K. 

We can now define 

u{q) := liminf(T;(t, g) + to). 

t — ^oo 

We claim that u is a Weak KAM solution at level a. Since the functions vt + ta are equi- 
Lipschitz and equi-bounded, the function u is well-defined and Lipschitz. We have to prove that 
T*^ + ta = u for aU t ^ 0. 
We have 

v{t + s, qi) + {t + s)a ^ v{s, qo) + sa + A^{qo, qi) + ta 

for each qQ, qi and t ^ 0, s ^ 0. Taking the liminf in s yields 

uiQi) ^ uiQo) + A\qo, qi) + to. 

We have proved that n is a sub-solution to (HJa). 

Conversely, we have to prove that T^u+ta ^ u. Let us pick a point q and consider a sequence 
tn such that v{tn,q) + tnd — > u{q). Fixing t > 0, we consider a sequence qn in W^ such that 

v{tn, q) + tna = v{tn - t, qn) + (i„ - t)a + A\qn, q) + ta. 

This equality implies that the sequence g„ is bounded, and we assume by taking a subsequence 
that it has a limit q' . We can also assume that the sequence f (t„ — t, q') + {tn — t)a has a limit, 
that we denote by /. Note that I ^ u{q'). Since the functions vt are equi-Lipschitz, we have 
v{tn — t, qn) + {tn — t)a — > I hencc, taking the limit in the equality above, 

u{q) = I + A\q', q) + af^ u{q) + A\q' , q) + af^ T*n(g) + at. 

We have proved that n is a periodic Weak KAM solution at level a. q 

The periodic Weak KAM solutions at level a are the periodic viscosity solutions of (HJa), 
as is proved in Fathi's joined lecture. The existence of periodic viscosity solutions was first 
obtained by Lions, Papanicolaou and Varadhan in a famous unpublished preprint, [15]. The 
most important aspect of Fathi's weak KAM theorem that we just exposed is that these viscosity 
solutions have a dynamical relevance and give rise to invariant sets. 

Let us comment a bit further in that direction, and explain the name "Weak KAM". Consider 
a periodic Lipschitz function u, and the associated set F^, that we consider here as a subspace 
ofT'^ xM"'*. 
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Assume first that u is C^, so that Tu is a C^ graph. This graph is invariant if and only if 
there exists a such that u solves (H Ja) . This follows from Section 1 : If n solves (H Ja) , then the 
function U{t, q) = u{q) — at solves HJ, hence 

^\Tu) = Tu, = Tu. 

Conversely, if Tu is invariant, then Trj^t^ = ^^(Xu) = T^, by Corollay 3, hence T*tt is equal to 
u up to an additive constant a{t). Since T* is a semi-group, it is easy to deduce that a{t) = at 
for some a G M. As a consequence, u is a C^ Weak KAM solution, hence a classical solution of 
(HJo). 

The classical KAM theorem gives the existence, in certain very specific settings, of some 
invariant C^ graphs of the form Tu- Prom what we just explained, it can be interpreted as 
giving the existence of C^ solutions of (HJa), although this point of view is not the right one 
to obtain its proof. It is natural to expect that the Hamilton-Jacobi equation could be used to 
produce invariant sets in more general situations. Since we do not know any direct method to 
prove the existence of C^ solutions of (HJa), we should deal with some kind of weak solutions. 
However, if u is just a Lipschitz solution almost everywhere, we can't say much about the 
dynamical properties of Tu- It is remarkable that the inclusion ip^{Tu) D Tu holds for viscosity 
solutions (or, equivalently Weak KAM solutions) in the convex case. This is the starting point 
of Fathi's construction of the invariant set I*{u) that we exposed in the present section. 

7 Regular sub-solutions and the Aubry set. 

We abandon for a moment the hypothesis 5, and consider a Hamiltonian satisfying Hypotheses 
1, 2, 3, 4. We describe a new construction of invariant sets based on the study of regular sub- 
solutions, and define the Aubry set. We mostly follow [4] in this section. The following result is 
at the base of our constructions, see [4, 2, 13]. 

Theorem 6. // (HJa) admits a sub-solution, then it admits a C^'^ sub-solution. Moreover, the 
set of C^'^ sub-solutions is dense in the set of all sub-solutions for the uniform topology. 

Proof. Let u be a sub-solution at level a. We use the operator R* = T"^* o t('^+^)* o T* of 
Theorem 4 to regularize u. Since the operators T* and T* preserve sub-solutions, so does R*. 
We claim that 

u-{C + a){l + 5)t ^ R*u ^ n + (C7 + a)(l + 5)t 

with a constant C which depends only on m and M. This implies that the function R*u is finite 
valued. If the parameter 5 has been chosen small enough, then, by Theorem 4, the functions R* 
are C^'^ sub-solutions, which converge uniformly to u as t — > 0. The bound on R*u claimed 
above follows from the following ones in view of Property 19, 

V - sa<, T:% i^v + Cs, v-Csi^ T^ i^ v + sa 

which hold for each s ^ and each sub-solution v at level o. The first one can be seen by writing 

u{q) -asi^ T^'u{q) ^ u{q) + A\q, q) ^ u[q) + Cs. 

This ends the proof of Theorem 6. Observe that we could have used the simpler operator T oT*, 
as was done in [ ], but the operator R* deserves attention for some nicer properties. q 

Definition 27. The critical value of H is the real number a (or a{H)) defined as the infimum 
of all real numbers a such that (HJa) has a sub-solution. The sub-solutions of (HJa) are called 
critical sub-solutions. 
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Lemma 28. We have the estimate —M ^ a ^ M . 

Proof. The function u = is a sub-solution at level M, hence a ^ M. Conversely, since 
H ^ —M there exists no sub-solution at level a when o < — M. q 

Proposition 29. There exists a C^'^ sub-solution of (HJa). 

Proof. Let an be a sequence decreasing to a. Since an > a, the Hamilton- Jacobi equa- 
tion at level a„ has a sub-solution m„. The sequence Un is equi-Lipschitz, and we can assume 
by adding constants that it is also equi-bounded. Taking a subsequence, we can also assume 
that it converges locally uniformly to a limit u. Taking the limit n — > oo in the inequalities 
Un{qi) - Uniqo) ^ -4*(go,gi) + tan gives u{qi) - u{qo) ^ A\qo,qi) + tan- This holds for all 
§0,^1 and t > 0, hence n is a sub-solution at level a, or in other words a critical sub-solution. 
Since there exists a critical sub-solution, Theorem 6 implies that there exists a C^'^ critical 
sub-solution. q 

Definition 30. The projected Aubry set is the set A G Mr of points q such that the equality 
H{q,du{q)) = a holds for all C^ critical sub-solutions u. 

We point out that A might be empty without additional hypotheses. 

Lemma 31. If q £ A, then all C^ critical sub-solutions u have the same differential at q. In 
other words, the restriction F^m does not depend on the C^ critical sub-solution u. 

Proof. Let u and v be two critical sub-solutions, and q a point in A. We have to prove that 
du{q) = dv{q). Assume, by contradiction, that this equality does not hold and consider the 
sub-solution w = {u + v)/2. Since II{q, du{q)) = II{q, dv{q)) = a, the strict convexity of II{q, .) 
implies that II{q, dw{q)) < a, which contradicts the definition of A. q 

Lemma 32. There exists a C^'^ sub-solution uq which satisfies the strict inequality II{q, duo{q)) < 
a for all q in the complement of A. 

Proof. The set of C^ functions is separable for the topology of uniform C^ convergence on 
compact sets. This topology can be defined for example by the distance 

,/ X v^supi |^„arctan(|u(g)| + |dn(g)|) 
d{u,v) = ^ . 

n 

Since a subset of a separable space is separable, there exists a sequence m„ of C^ critical sub- 
solutions which is dense for this topology in the set of all C^ critical sub-solutions. Let us 
set 



2" supfc^„j^|^„(l + \ukiq)\ + \dukiq)\)) 

and choose ao such that X^„>i an = 1- The sum X]n>i (^nUn converges uniformly with its 
differentials on each compact sets to a C^ limit vq. The function vq is a critical sub-solution, 
and we claim that H{q,dvo{q)) = a if and only if q belongs to A. Indeed, this equality holds 
only if all the inequalities II(q, dun{q)) ^ ol are equalities, which, in view of the density of the 
sequence «„, implies that H{q,du{q)) = a for all C^ sub-solutions u. By definition, this implies 
that q belongs to A. We have constructed a C^ sub-solution vq such that 

H{q,dvo{q)) < a 
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outside of A. We have to prove the existence of a C^'^ critical sub-solution with the same 
property. We consider a smooth function V{q) which is bounded in C^, which is positive outside 
of A, and such that 

O^V{q)^a-H{q,dvo{q)) 

for all q G M". The modified Hamiltonian H{q,p) = H{q,p) + V{q) satisfies all our hypotheses. 
Since H ^ H, the corresponding critical value a satisfies d ^ a. Since vq is a sub-solution of 
the inequation 

H{q,dvo{q)) ^ a, 

we can apply Theorem 6 to iJ at level a, and obtain the existence of a C^'^ sub-solution uq to 
the same inequation. The inequality 

H{q,duo{q))^a-V{q) 

implies that uq is a critical sub-solution for H which is strict on the set {F > 0} which, from 
our construction oi V, is the complement of A. q 

Definition 33. The Aubry set A* is defined as: 

where the intersections are taken on the set of C^ critical sub-solutions. 

In view of Lemma 31 we have A* = T^^^^ for each C^ sub-solution u, hence tt{A*) = A, where 
TT : M*^ X M"^* — > W^ is the projection on the first factor. To check the second inequality, it is 
sufficient to prove that HuTu C A*. Let uq be a C^ critical sub-solution such that H{q, duo{q)) < 
a outside of ^. Given a point {qo,Po) in '^uq —A*, we can slightly perturb the critical sub-solution 
uo around qo to a critical sub-solution ui such that dui{qo) / duo{qo) (we use the strict inequality 
H{q, duo{q)) < a). The point {qo,po) does not belong to F^^, hence it does not belong to CiuTu, 
which ends our proof. 

The set A* is contained in the Lipschitz graph T^q for each C^'^ sub-solution uq. As in 
Section 6, we have obtained an invariant set contained in a Lipschitz graph, but which may be 
empty in general: 

Proposition 34. The Aubry set is a closed invariant set. 

Proof. Let uq be a C^'^ critical solution such that H(q,duQ{q)) < a outside of A. By 
Proposition 22, there exists T > such that T*no is still C^'^ for t £ [-T,T]. Given {q,p) £ A*, 
we conclude that, for t G [0,r], we have p = d{T^uo){q). Setting 6 = Q~^{q,p), the addendum 
to Proposition 22 implies that T^uo{q) = uo{6) + S^{6,q), and that 

ip\0,duo{d)) = {q,p). 

Since the flow preserves the Hamiltonian, we get that H{6,duo{6)) = a, hence the point 6 
belongs to A, and then 

ip-\q,p) = {9,duo{9))€A*. 

We have proved that ip~^{A*) C A* for t E [0, T]. We can prove in a similar way, using the C^'^ 
sub-solution T^uq instead of T*no, that ip^{A*) C A* for t G [0,r], and hence that 

ip\A*) = A* 

for each t G [—T, T] , which clearly implies that this equality holds for all t. We have proved the 
invariance of ^* . q 
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Proposition 35. The equality 

T^u{q) -ta = u{q) = T*n(g) + ta 

holds for each critical sub-solution u, each t ^ and each q ^ A. The inclusion A* C F^ holds 
for each critical sub-solution, hence the inclusion A* C T*{u) holds for each weak KAM solution 
at level a. 

Proof. Let {q{s),p{s)) be a trajectory contained in A*, and t ^ be given. For each C^ 
critical sub-solution n, we have p{s) = duqi^^-^, and 

u{q{t)) - u{q{0)) = / dUg(^s)q{s)ds = ta + dMg(^)g(s) - H{q, dUg,^s))ds 
Jo Jo 

^A\q{0),q{t))+ta. 

Since li is a critical sub-solution, the second point in Proposition 23 implies that the last in- 
equality must be an equality, hence 

u{q{t)) - u{q{s)) = A'''{q{s),q{t)) + {t - s)a 

for each t ^ s. In the terminology of Fathi, we have proved that the curve q{s) is calibrated by 
the sub-solution u. We can now write 

u{q{t)) ^ T*n(g(t)) + to ^ u{q{0)) + A\q{0),q{t)) + ta = u{q{t)). 

This implies that T^u + ta = u on A, and, similarly, T*n — ta = u on ^. Let us now fix t £]0,a[. 
Given an orbit {q{s),p{s)) in A* , we have 

uiq{0)) ii u{e) + S\9,qi0)) + ta 

for each sub-solution u and each 6, with equality at ^ = q{—t). This implies that diS{q{—t), q{0)) 
is a super-differential of u at q{0). This holds in particular for C^ sub-solutions, which satisfy 
du{q{0)) = p{0), hence diS{q{—t), q{0)) = p{0). We have proved that p(0) is a super-differential 
of u at q{0). Similarly, using the inequality 

u{q{0)) ^ u{e) - S\q{0),9) - ta, 

with equality at 6* = q{t), we conclude that p{0) is a sub-differential of u at q{0). This implies 
that u is differentiable at g(0), and that du{q{0)) = p{0). As a consequence, A* C Tu for each 
sub-solution u. q 

In the course of the above proof, we have established the following lemma, which will be 
needed later: 

Lemma 36. Let u be a sub-solution at level a, and let {q{s),p{s)) be a Hamiltonian trajectory 
contained in F^ n {H = a} (note that this set is not necessarily invariant in general), then, the 
equality T*u{q{s)) — ta = u{q{s)) = T*n(g(s)) -|- ta holds, for each t ^ and each s G R. 

8 The Mane Potential. 

In this section, we work with a Hamiltonian satisfying Hypotheses 1, 2, 3, 4. The Maiie Potential 
at level o is the function 

^"(^0,gi) :=ud{A\qo,qi) + at). 
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This function was first introduced by Ricardo Marie, see [ ]. We leave as an easy exercise for 
the reader to prove the triangle inequality 

In view of Proposition 23, each sub-solution u at level a satisfies 

u{qi)-u{qo) ^ $"(go,gi) 

for each qo and qi. We conclude that ^"^ is finite if there exists a sub-solution at level a, which 
holds if and only if a ^ a. Conversely, If the function $" is finite, then we see from the triangle 
inequality that the function q i — > ^°'{qo, q) is a sub-solution at level a, which implies that a^ a. 
The estimates of Lemma 13 imply that 



^''{qo,qi) ^ 2y/2m{M + a)\qi 



Qo\ 



provided a ^ a (note that a ^ —M ). We have proved that the Maiie Potential is the function 
called the viscosity semi-distance in Fathi's lecture: 

Proposition 37. Ifa^a, then the function q i — > ^""{qo, q) is the maximum of all sub-solutions 
u at level a which vanish at q^. If a < a, then there is no such sub-solution and $'^ is identically 
equal to -co. 

This statement also implies that the Marie Potential at level a only depends on the energy 
level {H = a}. More precisely, let G be another Hamiltonian satisfying our hypotheses and 
such that H = a -^ G = a. Then, the sets {H ^ a} and {G ^ a} are equal, which implies in 
view of the first characterization of sub-solutions in Proposition 23 that G and H have the same 
sub-solutions at level a. As a consequence, they have the same Maiie potential at level a. This 
is also reflected in the following Proposition by the fact that the involved orbits are contained 
in the set {H = a}. 

Proposition 38. Given qo ^ qi , there exists r g]0,oo] and an orbit ((?(s),p(s)) : (— r, 0] — > 
R'^ X M'^* such that q{0) = qi, A%qo,q{s)) - as = <^'' {q{s) , qi) , 

^''{qo,q{s)) + <^''{q{s),qi) = '^''{qo,qi) 

and H{q{s),p{s)) = a for each s £ (— r, 0]. // moreover r is finite, then q{—T) = go- 

Proof. If q^ 7^ gi, then either the functions t 1 — > ^*(go,(?i) + at reaches its minimum at some 
finite time r > 0, or it has a minimizing sequence r„ — > 00. This follows from Lemma 13. 

In the first case, there exists an orbit {q{t),p{t)) : [— r, 0] — > M.'^xW^* such that q{—T) = q^, 
g(0) = qi, and 

/ p-q-H{q,p)dt = A^{qo,qi) = <^''{qo,qi) - ra. 
We obtain, for each s G [— r, 0], that 

/O rs I'D 

p-q- H{q,p)dt = p-q- H{q,p)dt + p-q- H{q,p)dt 

^A^+-{qo,q{s))+A-%q{s),q,) 

^ ^"{qo, q{s)) - a{s + r) + ^''iq{s),qi) + as 

^ $"(go,gi)-ar. 
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We conclude that all these inequalities are equalities, hence 

^"(go,9(s)) + ^"('7(s),'Zi) = <J>"(go,gi). 

We also deduce from the above chain of inequalities that A~^{q{s), qi) —as = ^"' {q{s) , qi) , which 
implies that the function t i — > A^{q{s), qi) + at is minimal for t = —s. Taking s g] — a, 0[, we 
can differentiate with respect to t at t = — s and get 

dtit=-sS\q{s),qi)+a = 0. 

Recalling the equality 

dtS-'{q{s),qi) + H{qi,p{0))=0 

(because p(0) = pi{—s, q{s),qi) in the notations of Section 2), we conclude that H{qi,p{0)) = o, 
and, since the Hamiltonian is constant on Hamiltonian orbits, H(q{t),p{t)) = a for each t. 
In the second case, there exists a sequence of orbits (quit) , Pn{t)) on [— r„,0] such that 

/ Pn -qn - H{qn,Pn)dt + aTn = A'^''{qo,qi) + aTn ^ ^"'{qo,qi) +6n, 

J -Tn 

where 5n — > 0. Let us denote hn := H {qn{s) , pnis)) , it does not depend on s. By Lemma 14 
and the above inequality, we have 



m 

M 



Tnhn - {m + M)Tn ^ / p„ • dpH{qn,Pn) - H{qn,Pn)dt ^ $"(^0, ^l) + S„ 



hence the sequence hn is bounded. As a consequence, the curves Pn{s) are uniformly bounded, 
hence so is qn{s) = dpH[qn{s),pn{s)). On each compact interval of time [s,0], the curves 
Xn{t) = iQn{t) , Pnit)) Sive thus Uniformly bounded, hence uniformly Lipschitz. Up to taking a 
subsequence, we can thus assume that the curves x„(t) converge, uniformly on compact time 
intervals, to a Hamiltonian orbit x{t) = {q{t),p{t)) : (— oo,0] — > M x M . Passing at the limit 
in the inequality 

^''{qo, qn{s)) + $"(gn(s), qi) < '^"{qo, qi) + 6n, 

which holds for each s £ [—Tn, 0], yields 

'^''{qo,q{s))+1>''{q{s),qi)^<^''{qo,qi), 

which must actually be an equality. We prove as in the first case that H(qi,p{0)) = a, thus 
H{q{s),p{s)) = a. □ 

The projected Aubry set A can be characterized in terms of the Mane potential (see also 
Fathi's lecture): 

Proposition 39. The following statements are equivalent for a point qo and a real number a, 
where we denote by u the function <5"(goi •)■' 

1. qo £ A and a = a. 

2. T*u(go) + ta = u{qo) = for each t ^ 0. 

3. The function u is a Weak KAM solution at level a. 
4- u is differ entiable at qo- 
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Proof. 1 =^ 2. This follows from Proposition 35 since u is a sub-solution at level a = a. 

2 =^ 3. Let us fix i > and qi. We have to prove that there exists 8 such that u{qi) ^ 
u{6) + A^{9, qi) + ta (this inequality is then an equality). If qi = qo, the existence of this point 
follows from the equality T*u{qo) +ta = u{qo). 

If qi 7^ qo, we can apply Proposition 38 to this pair of points. With the notations of 
Proposition 38, if r ^ t, then the point 6 = q{—t) fulfills our demand. If r < t, then we set 
s = t — T. We have q{—T) = qo and A'^{qo,qi) + ar = u{qi). Since T^u{qo) + sa = n(go), there 
exists 9 such that u{9) + A^{9,qo) + sa = u{qo) = 0. The infimum in the definition of T''n(go) 
exists because u is Lipschitz. We conclude that 

u{9) + A\9, qi) + at ^ u{9) + A'{9, go) + sa + ^^(go, Qi) + or = u{qi). 

3 =^ 4. If M is a Weak KAM solution, then it has a proximal super-differential at each 
point. Conversely, if u is a C^ sub-solution, then u — v has a minimum at q^ hence dv{qo) is a 
sub-differential of u at q^o ■ The function u both has a super-differential and a sub-differential at 
qo, hence it is differentiable at go- 

4 =► 1. If a > a or if go does not belong to A, then there exists a C^ sub-solution v at 
level a which is strict near go- We can then slightly perturb the function v near go and build 
a sub-solution w such that dw{qo) / dv{qo). In view of the characterization of u as the largest 
sub-solution vanishing at go, we conclude that dv{qo) as well as dw{qo) are sub-differentials of u 
at go, hence u is not differentiable at this point. g 

The Maiie potential also allows to build Weak KAM solutions in the non periodic case by 
the Busemann method, see [11] and Fathi's Lecture. Let g„ be a sequence of points of M'^ such 
that |g„| ^ n. We consider the sequence of functions 

By construction, Un{qo) = 0, and it follows from the triangle inequality that the functions Un are 
equi-Lipschitz. We can then assume, without loss of generality, that the functions ii„ converge, 
uniformly on compact sets, to a Lipschitz limit u{q). 

Proposition 40. The limit function u{q) is a Weak KAM solution at level a. 

Proof. The functions Un are all sub-solutions at level a, which means that u„,(gi) — Un{qo) ^ 
A^{qo,qi) + ta for each t ^ 0, go, gi- At the limit n — > oo, we obtain that that T*u + ta '^ u 
for each t ^ 0. 

We have to prove that T*n + ta^u for all t ^ 0. Let us fix a point g and a time t ^ 0, and 
consider a sequence t^ such that 

^*" [qn, q) + atn ^ $"(gn, q) + l/n. 
This inequality implies that 

^J^lln - gP ^ 1 + (M - a)tn + 2^/2m{M + a)\qn - q\ 

and, since \qn — g| — > oo, that tn — > oo. When n is large enough, we have tn ^ t and there 
exists 9n G M"^ such that A*"(g„, g) = A*""*(g„, 9n) + A*(6'„, g). This implies that 

$''(g„,g) ^ A*"{qn,q)+atn-l/n 

^ yl*""*(g„, 9n) + a{tn -t) + A\9n, q) + at- l/n 
^ ^'^(gn, 9n) + A\9n, q) + at - l/n. 
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This inequality implies that 

Un{q) ^ Un{On) + A^O^, q) + at - l/u. 

Since the functions u„ are equi-Lipschitz, this implies that the sequence 0„ is bounded, by 
Lemma 13. By taking a subsequence, we assume that 6n has a limit 9, and, at the limit, we 
obtain 

u{q) ■^u{9)+A\e,q) + at, 

which implies that u{q) ^ T*u(g) + ta. q 



9 Return to the periodic case. 

A more precise link can be established between the contents of Sections 6 and 7 under the 
assumption that H is periodic (see Hypothesis 5). It is useful first to expose a variant of Section 
7 adapted to the periodic case. We leave as exercises the proofs which are direct adaptations of 
the ones given above. From now on, we assume Hypotheses 1, 2, 3, 4, 5. 

Theorem 7. // (HJa) admits a periodic sub-solution, then it admits a periodic C^'^ sub-solution. 
Moreover, the set of periodic C^'^ sub-solutions is dense in the set of all periodic sub-solutions 
for the uniform topology. 

Definition 41. The periodic critical value of H is the real number a(0) defined as the infimum 
of all real numbers a such that (HJa) has a periodic sub-solution. The periodic sub-solutions at 
level a(0) are called critical periodic sub- solutions. 

Definition 42. The projected periodic Aubry set is the set A{fS) C T*^ of points q such that the 
equality H{q, du{q)) = a(0) holds for all C^ periodic critical sub-solutions u. 

Lemma 43. If q ^ -^(0), then all C^ critical periodic sub-solutions u have the same differential 
at q. In other words, the restriction F^m does not depend on the C^ critical periodic sub-solution 
u. 

Proposition 44. There exists a C^'^ periodic critical sub-solution uq such that H{q,duo{q)) < 
a(0) outside ofA{0). 

Without surprise, we define the periodic Aubry set A* (0) as 

X(0):=F,„|^, 

with no given by the proposition (there is not a single uq, but the Aubry set is well defined). 

Proposition 45. The set ^*(0) C T x M is compact, non empty, and invariant. 

Proof. Let us prove that ^(0), hence ^*(0) is not empty. Assuming by contradiction that it 
was empty, then the equality H{q,duo{q)) < a(0) would hold for all q G M'^. Since the function 
q I — > H{q,duo{q)) is periodic, we could conclude that sup qH{q,duo{q)) < a(0), which is in 
contradiction with the definition of a(0). q 

We are now in a position to specify the connection with the invariant sets introduced in 
Section 6: 
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Proposition 46. In the periodic case, we have the equality 

^*(0)=n„X*(n), 
where the intersection is taken on all periodic weak KAM solutions. 

Proof. The inclusion ^*(0) C 0^2^* (u) is proved as in Section 7. Our goal is to prove the 
other inclusion. Let uq be a C^'^ periodic sub-solution which is strict outside of ^(0). The 
map t I — > T*iio + ta(0) is non-decreasing. In addition, the functions T*uo + ta(0) are equi- 
Lipschitz, and they coincide with uq on A, hence they are equi-bounded. As a consequence, 
T*uo + ta — > Uoo uniformly as t — > cxd. 

Claim: The limit Uoo is a periodic weak KAM solution such that uq < Uoo outside of .A(O). 

In order to prove that Uoo is a weak KAM solution, it is enough to notice that the function 
T*"'"*tio + (t + s)a(O) converges both to Uqo and to T^'uoo + sa{0) when t — > oo. This implies, 
as desired, that T^Uoo + sa{0) = Uoo for each s ^ 0. 

We know that Uqo ^ ""O; with equality on ^(0). Conversely, let us consider a point q such 
that Uoo{q) = uo{q). The point q is minimizing the difference Uqo — uq. Since Uoo is semi- 
concave and uq is C^, the function Uqo must be differentiable at q with duoo{q) = duQ^q). 
Since Mqo solves the Hamilton- Jacobi equation at its points of differentiability, we conclude that 
H{q,duo{q)) = H{q,duoa{q)) = a(0), hence q G ^(0). We have proved the claim. 

Let us now establish that X{uoo) = -4.(0), which implies the proposition. By Lemma 36, we 
have T*Moo — to = -Uqo on X{uoo) for each t ^ 0. Setting e{t) = sup(uoo — T^-uq — to(0)), we have 

noo ^ no ^ t* o T*uo ^ t*(noo - e{t) - to(0)) ^ t*Uoo - e{t) - to(0) = Uoo - e{t) 

on X(uoo)- Since this holds for all t ^ 0, and since lim^ ^oo e(i) = 0, we conclude that uq = u^o 

on I{uoo). On the other hand, we have seen that uq < Mqo outside of .4.(0), hence X(uoo) C .4(0). 

n 

We finish with an easy remark which is specific to the periodic case: 

Proposition 47. All periodic weak KAM solutions have level a(0). 

Proof. Let no be a critical periodic sub-solution, and let n be a periodic weak KAM solution at 
level a. Since n is a periodic sub-solution at level a, the definition of a(0) implies that a ^ q;(0). 
On the other hand, there exists a constant C such that u — C^uq^u + C, which implies 

u = T*ii + to ^ T*uo -C + ta'^ uo + t{a- a(0)) -C '^ u + t{a- a(0)) - 2C. 

We obtain that t{a — a(0)) ^ 2C for each t ^ 0, hence a — a(0) ^0. q 



10 The Lagrangian. 

In most expositions of weak KAM theory, the Lagrangian plays an important role. In the present 
section, we relate it to our main objects in order to facilitate the connection with the core of 
the literature, where what we state here as properties is usually taken as definitions. We define 
the Lagrangian as 

L : R X R"^ X W^' — >R 

{t,q,v)f — > sup [p-v - H{t,q,p)). 
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By standard results on convex Analysis, see[ ] for example, we then have 

H{t, q, p) = sup [p-v - L{t,q,v)). 



We obviously have the Legendre inequality 

H{t, q,p) + L{t, q,v) ^ p-v 
for all t, q,p, v. This inequality is an equality if and only if 

p = dyL{t, q, v) or equivalently v = dpH(t, q,p). 
Let q{t) :]to, ti[ — > M be a curve. The action of q is the number 

L{t,q{t),q{t))dt. 
to 

We can also call it Lagrangian action if we want to distinguish from the previously defined 
Hamiltonian action. The Lagrangian and Hamiltonian actions are related as follows: 

The Hamiltonian action of a curve {q{t),p{t)) is smaller than the Lagrangian action of its pro- 
jection q{t), with equality if and only if p(t) = dvL{t,q{t),q{t)). In particular, the Hamiltonian 
action of an orbit is equal to the Lagrangian action of its projection. 

Lemma 48. let qo and qi be two points ofM., and to,ti be two times, with < ti — to < a. If 
{q{s),p{s)) is the orbit satisfying q^to) = qo,q{ti) = qi, we have 

rti rh 

Sll{qo,qi)= L{s,q{s),q{s))ds = mm L{s,e{s),9{s))ds, 
Jto "(«) Jto 

where the minimum is taken on the set of Lipschitz curves 6 : [to,ti] — > M.'^ which satisfy 
Oito) = qo and 9{ti) = qi. 

Proof. Since Sf^{qo,qi) is the Hamiltonian action of the unique orbit {q{t),p{t)), it is also the 
Lagrangian action of the curve q{t): 



f 
Sll{qo,qi)= L{s,q{s),q{s))ds. 

Jto 



The function u{t,q) := SJg{qo,q) solves (HJ) on ]io,ii[xIR'^- Let us now consider any Lipschitz 
curve 6{s) : [to,ti] — > M"' satisfying 0(to) = qo and 0{ti) = qi, and write 

' L{s, e{s),e{s))ds ^ I ' dqu{s, e{s)) ■ e{s) - H{s, e{s),dqu{s, e{s))ds 

to Jto 

tl 

dgu{s, e{s)) ■ e{s) - dtu{s, e{s))ds 
to 

= u{ti,qi) -u{to,qo) = Sll{qo,qi). □ 

The following proposition is usually taken as the definition of A: 

Proposition 49. Given two points qo and qi and two times to < ti, we have 

rti 

9{s) Jto 

where the minimum is taken on the set of Lipschitz curves 6 : [to,ti] — > M'^ which satisfy 
Oito) = qo and 9{ti) = qi. 
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^to(9o,gi) = min / L{s,9{s),e{s))ds, 



It is part of the statement that the minimum is achieved. This is usuahy cahed the Theorem 
of Tonelh. The statement can be extended to absolutely continuous curves instead of Lipschitz 
curves, but this setting is not useful for our discussion. 
Proof. For n large enough, we have (ti — to)/^ < o') hence, setting tj = to + ^(^i — tQ)/n, 

All{qo,qi)= min (Sl^{q,,e,) + S;i{e,,d2) + ■ ■ ■ + Sil_^{9^^i,q,)) 

(Ol,...,On-l) 

= min (min / L{s,9(s),0is))ds + . . . + rQ\n I L(s,9(s),6(s))ds) 
(ei,...,e„_i) ^ e{s) Jt„ eis) 7^„_^ v ; v // / 

= min / L{s,9{s),6{s))ds. q 

A Some technical results. 

Proposition 50. A Lipschitz map F : M — > M which satisfies Lip{F — Id) < 1 is a bi- 
Lipschitz homeomorphism ofW^. Its inverse is Lipschitz and Lip{F^^) ^ (1 — A;)^-*^. If F is C^, 
then so is F^^ . 

Proof. The equation F{q) = 6 can be rewritten 

_ ^F{q) -q)=q 

The map on the left being contracting, we conclude that F is invertible. We now write 

|xi - xol - \F{xi) - F{xo)\ ^ \{F{xi) - xi) - (F(xo) - a:o)| ^ k\xi - xq\ 

and deduce that \F{xi) — F{x2)\ ^ (1 — k)\xi — xq\. q 

Proposition 51. Let F : R — > M be a C^ , c-monotone map on M , with c > 0. Then F is a 
diffeomorphism from R onto itself. 

Proof. Let us consider a point 9 G R'^, and the line 9{s) = F{0) + s{9 - F{0)). Since F is 
a local diffeomorphism around 0, the points 9{s) for small s have a unique preimage p{s). Let 
S be the infimum of the positive real numbers s such that the equation F{p) = 9{s) does not 
have a solution in M^. The curve p{s) is well-defined, C^, and Lipschitz on [0, S[, hence, if S is 
finite, it extends at S with with F{p{S)) = 9{S). Since F is a local diffeomorphism at p{S), the 
points near 9(S) have preimages, which contradicts the definition of S. Hence S can't be finite, q 

Lemma 52. Let A be a d x d matrix, such that A ^ aid in the sense of quadratic forms, and 
\\A\\ ^ b. Then A^^ ^ {a/b'^)I in the sense of quadratic forms. 

Proof. We have 

{A'^v,v) = {AA-^v,A-^v) ^ a\A-^v\'^ ^ aiH/bf- 

D 

The following important result appears in Fathi's book on Weak KAM theory (the proof is 
also his): 

Proposition 53. Let u : M^ — > M. be a function and K be a positive number. Let I £ M.'^ be 
the set of points where u has both a K -super- differential and a K -sub-differential. Then, the 
function u is differentiable at each point of I and the function q i — > du{q) is &K -Lipschitz on 
X. 
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Proof. For each q & T, there exists a unique l{q) € M such that 

\u{q + 9)- u{q) - l{q) ■ e\ ^ i^||0f . 

We conclude that l{q) is the differential of u at g, and we have to prove that the map q i — > l{q) 
is Lipschitz on X. We have, for each g, 9 and y in i:f : 

l{q) -{y + e)- K\\y + ef <^u{q + y + e)- u{q) ^ /(g) • (y + 0) + K\\y + ^f 

^(g + y) ■ i-y) - K\\y\\^ ^ u{q) - u{q + y) ^ l{q + y) ■ {-y) + K\\y\\^ 
l{q + y) ■ i-O) - K\\9f ^ u{q + y)-u{q + y + 9)^ l{q + y) ■ (-9) + K\\9f. 
Taking the sum, we obtain 

\il{q + y)- l{q)) -{y + O)]^ K\\y + 9f + K\\yf + K\\zf. 

By a change of variables, we get 

\iliq + y) - Kq)) ■ 9\ i^K\\9f+K\\yf + K\\9-y\\'^. 

Taking ||^|| = ||y||, we obtain 

\(l(q + y)-^q)).{9)\^6K\\9\\\\y\\ 

for each 9 such that 116*11 = ||y||, we conclude that 

\\l{q + y)-l{q)\\^6K\\y\\. 

a 

Lemma 54. Let u be a finite valued function which is the infimum of a family T of equi-semi- 
concave functions: u = infjgjr/. Then the function u is semi-concave. 

It is important in the statement to assume that u is really finite valued at each point. 
Proof. Let us assume that the functions in T are fe-semi- concave. Given a point go £ ^'^ Ist 
fniq) = o,n + Pn ■ q + k/2\\q\\'^ be a sequence of functions of T such that fn{qo) — > '"(<?o)- We 
have fniq) ^ fn{qo) +Pn- [q — qo) + k/2\\q — goP for some sequence pn G M*. If the sequence pn 
is bounded, then we can take the limit along a subsequence and get the inequality 

u{q) ^ n(go) +p- (g- go) +k/2\\q- gof. 

If this holds for each go, we conclude that u is fc-semi-concave. Let us now prove that pn is 
bounded. If this was not true, there would exist a point g such that Pn' (q — qo) is not bounded 
from below. This would imply that 

u{q) = inf /(g) ^ inf /„(g) ^ inf (/„(go) + Pn ■ [q - qo) + k/2\\q - gof) = -oo, 

f^J^ n n ' 

which would contradict the finiteness of u at g. q 
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